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Abstract 

In  this  paper  we  demonstrate  that  the  distributional  laws  that  relate  the  number 
of  customers  in  the  system  (queue),  L  (<?)  and  the  time  a  customer  spends  in  the  sys- 
tem (queue),  S  (W)  under  the  first-in-first-out  (FIFO)  discipline  lead  to  a  complete 
solution  for  the  distributions  of  L,  Q,  S,  W  for  queueing  systems  which  satisfy  dis- 
tributional laws  for  both  L  and  Q  {overtake  free  systems).  Moreover,  in  such  systems 
the  derivation  of  the  distributions  of  L,  Q,  S,  W  can  be  done  in  a  unified  way.  Our 
results  include  a  generalization  of  PASTA  to  queueing  systems  with  arbitrary  renewal 
arrivals  under  heavy  traffic  conditions,  a  generalization  of  the  Pollaczek-Khinchin  for- 
mula to  the  GI/G/1  queue,  an  extension  of  the  Fuhrmann  and  Cooper  decomposition 
for  queues  with  generalized  vacations  under  mixed  generalized  Erlang  renewal  ar- 
rivals, new  approximate  results  for  the  distributions  of  L,  S  in  a  GI/G /oo  queue,  and 
new  exact  results  for  the  distributions  of  L,  Q,  S,  W  in  priority  queues  with  mixed 
generalized  Erlang  renewal  arrivals. 
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1      Introduction 

What  are  the  laws  of  electrodynamics?  In  order  to  address  this  question  we  should  first 
define  the  fundamental  quantities  of  electrodynamics,  the  electric  field  E  and  the  magnetic 
field  S.  The  fundamental  laws  of  electrodynamics  are  the  Maxwell  equations.  The  goal  of 
electrodynamics  is  then  to  find  E  and  B  in  various  applications.  The  Maxwell  equations 
form  a  complete  set  of  laws  in  the  sense  that  just  starting  from  them  and  using  the  calculus 
of  partial  differential  equations  one  is  able  to  compute  E  and  B  either  analytically  or 
numerically  in  a  variety  of  applications.  What  is  important  here  is  that  the  physics  of  a 
problem  is  summarized  in  the  Maxwell  equations,  which  then  lead  to  a  complete  solution 
for  E  and  B  in  a  unified  way. 

Let  us  then  ask  the  key  question  which  motivated  the  present  paper.  What  are  the 
laws  of  queueing  theory?  The  fundamental  quantities  in  queueing  theory  are  the  stationary 
queue  and  system  length  (Q,  L)  and  the  waiting  and  system  time  (W,  S)  under  the  First- 
In- First-Out  (FIFO)  discipline.  Of  course  there  are  several  other  random  variables  of 
interest  (often  particular  to  the  application  studied),  but  these  are  the  most  widely  used. 
The  goal  of  queueing  theory  is  then  to  find  the  distributions  of  Q,  L,  W,  S  in  various 
applications.  In  its  almost  a  hundred  year  history  queueing  theory  has  addressed  a  great 
variety  of  problems  using  a  variety  of  techniques,  which  solve  some  problems  but  fail  on 
others.  What  is  interesting  is  the  lack  of  a  unified  way  to  solve  a  particular  application. 
Queueing  theory  research  does  not  start  from  a  set  of  well  established  laws  and  then 
proceed  to  the  solution  using  some  well  established  mathematical  techniques.  It  rather 
uses  the  particular  characteristics  of  the  application  to  achieve  its  solution. 

Coming  to  our  original  question  regarding  the  laws  of  queueing  theory,  one  would  like 
to  have  a  set  of  laws  which,  similar  to  Maxwell  equations  in  electrodynamics,  lead  to  a 
complete  solution  of  the  queueing  application.  One  first  candidate  for  a  queueing  law  is 
Little's  law  [13]  (see  the  recent  review  of  Whitt  [16]  which  traces  the  different  forms  of  the 
law  and  its  extensions).  Let  us  examine  whether  Little's  law  leads  to  complete  solution  for 
the  steady  state  E[Q],  E[L],  E[W],  E[S]  in  a  GI/G/s  queue.  Let  A,  fi,  p  =  ^  <  1  be 


the  mean  arrival,  service  rate  and  traffic  intensity.  Then,  from  Little's  law  in  the  system 
and  the  queue 

E[L]  =  XE[S],  E[Q]  =  XE[W). 

But,  E[S]  =  E[W]  +  i,  while  the  relation  of  Q,  L  is 

E[zL)  =  z'E[zQ]  +  Y,  P(L  =  "H2"  ~  z")' 

n=0 

from  where 

»-i 

E[L)  =  s  +  E[Q]  -  Y,(3  ~  n)PiL  =  ">• 

n=0 

Combining  the  previous  equations  we  obtain  that 

£  *-^-P{L  =  n}  =  1  -  p, 

n=0 

which  is  exactly  what  Little's  law  would  give  if  it  were  applied  to  a  service  box  including 
the  customers  in  service.  For  example,  in  a  GI /G/l  queue  one  would  be  able  to  find  that 
P{L  =  0}  =  1  —  />,  but  it  would  not  be  possible  to  find  E[L],  As  a  result,  despite  its 
importance,  Little's  law  does  not  lead  to  a  complete  solution  for  expected  performance 
measures. 

Our  goal  in  this  paper  is  to  demonstrate  that  the  distributional  laws  first  obtained  by 
Haji  and  Newell  [7]  are  the  fundamental  queueing  laws  for  queueing  systems  which  satisfy 
distributional  laws  for  both  the  number  in  the  system  and  the  number  in  the  queue  (we 
will  call  them  overtake  free  systems).  We  demonstrate  that  the  distributional  laws  lead 
to  a  complete  solution  for  the  stationary  distributions  of  L,  Q,  5,  W  in  overtake  free 
systems.  Moreover,  in  such  systems  the  derivation  of  the  distributions  of  L,  Q,  5,  W  can 
be  done  in  a  unified  way.  In  this  way  not  only  we  obtain  new  simple  derivations  of  known 
results  providing  new  insights  to  old  results,  but  we  obtain  several  new  results  as  well. 
We  propose  two  methods  of  analysis  An  asymptotic  (as  p  — >  1)  method  which  applies  to 
overtake  free  systems  with  arbitrary  renewal  arrivals  and  an  exact  method  which  applies 
to  overtake  free  systems  with  mixed  generalized  Erlang  arrivals. 


For  the  case  of  Poisson  arrivals  Keilson  and  Servi  [10],  [11]  found  that  the  distributional 
laws  have  a  very  convenient  form  that  can  lead  to  complete  solutions  for  some  overtake 
free  systems.  For  the  case  of  mixed  generalized  Erlang  renewal  arrivals  Bertsimas  and 
Nakazato  [1]  gave  another  proof  of  the  distributional  laws  that  lead  to  a  very  convenient 
form  of  the  law.  They  also  proposed  a  framework  to  find  E[L],  E[Q],  E[S],  E[W]  in 
heavy  traffic  for  overtake  free  queueing  systems  based  on  the  distributional  laws.  In  this 
paper  we  develop  a  methodology  to  find  the  distributions  of  L,  Q,  S,  W  for  overtake  free 
systems  with  arbitrary  renewal  arrivals,  thus  generalizing  all  earlier  work.  Our  approach 
is  to  use  asymptotic  analysis  (which  is  exact  in  heavy  traffic)  for  the  case  of  arbitrary 
renewal  processes  and  exact  analysis  for  the  case  of  mixed  generalized  Erlang  renewal 
arrivals. 

The  paper  is  structured  as  follows:  In  Section  2  we  review  the  distributional  laws.  In 
Section  3  we  present  an  asymptotic  method  of  analysis  for  overtake  free  queueing  systems 
based  on  the  asymptotic  properties  of  the  distributional  laws  and  a  generalization  of  the 
well  known  result  of  Poisson  arrivals  see  time  averages  (PASTA)  to  queueing  systems  with 
arbitrary  renewal  arrivals  under  heavy  traffic  conditions.  Furthermore,  we  illustrate  the 
efficiency  of  the  method  by  deriving  the  distributions  of  L,  Q,  5,  W  in  GI/G/l,  GI/D/s 
queues  and  obtaining  new  approximate  results  for  the  distributions  of  L,  S  in  a  GI/G /oo 
queue.  Our  derivation  unifies  the  heavy  traffic  results  and  leads  to  a  generalization  of 
the  Pollaczek-Khinchin  formula  to  the  GI/G /l  queue.  In  Section  4  we  present  an  ex- 
act method  of  analysis  for  overtake  free  systems  with  mixed  generalized  Erlang  (MGE) 
renewal  arrivals  and  we  implement  it  in  the  case  of  MGEm/G/1  queue.  This  section 
demonstrates  that  there  is  a  direct  closed  form  expression  for  the  number  of  customers  in 
a  MGEm/G/1  system  while  our  approach  reproduces  the  known  results  for  the  waiting 
time  involving  roots  of  a  certain  nonlinear  equation  in  a  direct  way  without  the  need  for 
Hilbert  factorization.  In  Section  5,  as  another  application  of  the  exact  method  of  analysis 
for  overtake  free  systems,  we  extend  the  decomposition  results  for  queues  with  generalized 
vacations  considered  in  Fuhrmann  and  Cooper  [5]  for  the  M/G/l  queue  to  MGE  arrivals. 


In  Section  6  we  propose  an  algorithm  to  find  the  distributions  of  L,  Q,  S,  W  in  priority 
queues  with  mixed  generalized  Erlang  renewal  arrivals,  thus  we  generalize  earlier  results 
for  Poisson  arrivals.  The  derivations  in  this  section  are  considerably  more  complicated 
compared  with  the  results  in  previous  sections.  Finally,  in  Section  7  we  include  some 
concluding  remarks  and  indicate  directions  for  future  research. 

2      The  distributional  law 

In  this  section  we  first  review  the  distributional  law  for  arbitrary  arrivals  and  then  consider 
the  case  in  which  the  arrival  process  is  a  mixed  generalized  Erlang  renewal  process. 

2.1      A  review  of  the  general  distributional  law 

Consider  a  general  queueing  system,  whose  arrival  process  is  a  stationary  process.  Let 
Na(t)  be  the  number  of  customers  up  to  time  t  for  the  ordinary  process  (where  the  time 
of  the  first  interarrival  time  has  the  same  distribution  as  the  stationary  interarrival  time). 
Let  N*(t)  be  the  number  of  customers  up  to  time  t  for  the  equilibrium  process  (where 
the  time  of  the  first  interarrival  time  is  distributed  as  the  forward  recurrence  time  of  the 
arrival  process).  Let  also  L~ ,  L+  (Q~ ,  Q+)  be  the  number  in  the  system  (or  in  the  queue) 
just  before  an  arrival  or  just  after  a  departure,  respectively,  for  a  system  that  satisfies  the 
assumptions  of  Theorem  1  below.  The  distributional  law  can  be  stated  as  follows: 

Theorem  1  (Haji  and  Newell  [7])  Let  a  given  class  C  of  customers  have  the  following 
properties: 

1.  All  arriving  customers  enter  the  system  (or  the  queue)  one  at  a  time,  remain  in  the 
system  (or  the  queue)  until  served  (there  is  no  blocking,  balking  or  reneging)  and 
leave  also  one  at  a  time. 

2.  The  customers  leave  the  system  (or  the  queue)  in  the  order  of  arrival  (FIFO). 

3.  New  arriving  class  C  customers  do  not  affect  the  time  in  the  system  (or  the  queue) 
for  previous  class  C  customers. 


Then,  given  that  they  exist  in  steady  state,  the  stationary  time  spent  in  the  system  (queue) 
S  (W )  of  the  class  C  customers  and  the  stationary  number  of  the  class  C  customers  in 
the  system  (or  queue)  L  (Q)  are  related  in  distribution  by: 

l  =  K(S),  (i) 

Q  £  N:(W).  (2) 

In  addition, 

L~  =  L+  =  Na(S), 

Q-  ±Q+  i  Na{W). 

We  define  as  overtake  free  systems  those  systems  that  satisfy  both  (1)  and  (2).  Note 
that  for  the  general  distributional  law  the  arriving  process  need  not  be  a  renewal  process. 
If  we  consider  renewal  arrivals,  however,  some  interesting  relations  between  the  generating 
function  of  L  and  the  Laplace  transform  of  S  have  been  proved  in  Bertsimas  and  Nakazato 
[1]  and  are  reviewed  in  Theorem  2  below.  For  the  rest  of  the  paper  let  ct(s)  be  the  Laplace 
transform  of  the  interarrival  distribution,  with  arrival  rate  A  =  -l/d(0).  Let  Na(t)  be 
the  number  of  renewals  up  to  time  t  for  the  ordinary  renewal  process  and  N*(t)  be  the 
number  of  renewals  up  to  time  t  for  the  equilibrium  renewal  process. 

Theorem  2  (Bertsimas  and  Nakazato  [I])  Arrivals  of  class  C  form  a  renewal  process 
whose  interarrival  time  has  a  transform  a(s).  Under  the  assumptions  of  Theorem  1,  the 
distribution  function  Fs(t)  =  P{S  <  t}  of  S  and  the  generating  functions  Gl(z),Gi-(z), 
(?£,+  (z)  satisfy  the  following  relations: 

GL{z)=  r  K(z,t)dFs(t),  (3) 

./o 

GL-{z)  =  GL+(z)=  f°°  K0(z,t)dFs(t),  (4) 

and  the  distribution  function  Fw(t)  —  P{W  <  i)  of  W  and  the  generating  functions 
Gq(z),Gq-(z),Gq+(z)  satisfy  the  relations: 

GQ(z)=  f°°  K(z,t)dFw(t),  (5) 

Jo 


GQ-(z)  =  GQ+{z)  =  [°°  K0(z,t)dFw(t),  (6) 

JO 


n=0 

oo 


K0(z,t)='£znP{Na(t)  =  n}. 


n=0 


T/ie  Laplace  transform  of  the  renewal  generating  functions  K(z,t)  and  K0(z,t)  are  given 

*•(*■ «)  =  /"  e-  *(*,  t)  *  -  i  -  A(1 7 .f1 '  "n"-  <7> 

./o  5  «*(1  -  za(s)) 

A';(z,,)  =  fe-'  A'o(z,0d<  =     .j"^. 
./o  «(i  -  2«('»)j 

For  the  case  of  Poisson  arrivals  K(z,t)  =  A'0(z,£)  =  e-At(1-z)  and  thus  the  distribu- 
tional laws  become  a  relation  between  transforms  (Keilson  and  Servi  [10]): 

GL{z)  =  <t>s(\(l-z)).  (8) 

2.2      A  vector  distributional  law 

A  vector  generalization  of  (8)  has  been  proposed  in  Bertsimas  and  Nakazato  [1]  under  the 
assumption  that  the  arrival  process  is  a  mixed  generalized  Erlang  (MGE)  process,  which 
can  approximate  any  renewal  arrival  process  arbitrarily  closely.  The  stage  representation 
of  the  MGE  distribution  is  presented  in  Figure  1,  i.e.,  we  conceive  the  arrival  process  as  an 
arrival  timing  channel  (ATC)  consisting  of  M  consecutive  exponential  stages  with  rates 
Aj,  Aj, ..., Xm  and  with  probabilities  Pi,p?,  ...,Pm  (pm  =  1)  of  entering  the  system  after 
the  completion  of  the  1st,  2nd,  . . .,  Mth  stage. 

Let  afc(<)  be  the  pdf  of  the  remaining  interarrival  time  if  the  customer  in  the  ATC  is 
in  stage  k  =  1,...,M.    Therefore,  a(t)  =  ai(t)  is  the  pdf  of  the  interarrival  time.    For 
notational  convenience  we  will  drop  the  subscript  for  k  =  1.    Also  j  denotes  the  mean 
interarrival  time. 
Let  otk(s)  be  the  Laplace  transform  of  ajt(0- 


-»         X, 


p2 


^M 

I 

Pm-. 

1 

\ 

Figure  1:  The  Coxian  class  of  distributions 


Let  aj(t)  be  the  probability  to  move  from  stage  i  <  j  of  the  ATC  to  stage  j  during  the 
interval  [0,  t)  without  having  any  new  arrival. 
We  will  also  use  the  notation: 

al(t)  =  (aj(t) af(t))',al(t)  =  (0,...,a^),...,af  (*))'• 

ak(s)  denotes  the  Laplace  transforms  of  dl((). 
e,  =  (0,...,l,...,0)',  1  =  (1,...,1,. ••,!)'• 

By  introducing  the  following  upper  semidiagonal  matrix  Aq  and  the  dyadic  matrix  A%'. 

Ai     -(l-pi)Aj  0  •••  0 

0  A2  -(i-^jAj       ••.  • 


A0  = 


Am-i     -(1  -  Pm-i)Am-i 
0  AM 


-Pi\i      0    •••    0 

-PatAm     0    •  •  •    0 
we  can  express  compactly  the  transforms  denned  above  as  follows: 


ak'(s)  =  ek'(Is  +  A0r\ 


M 


M 


ak(s)  =  -ek  '(Is  +  ^o)-1^!^!  =  £  PrKal(s)  =  £  PrK^: 


nffil-pOAj 


T  =  k 


r  =  k 


nu(s  +  a,)  ' 


a(s)  =  -  tiace((Is  +  Ao)   lAi), 
thus  the  interarrival  pdf  becomes 

a(t)  =  -trace(e_Ao*Ai). 

Note  that  a  mixed  generalized  Erlang  renewal  process  is  fully  characterized  by  the  matri- 
ces Aq,  Ai.  In  queueing  systems  with  mixed  generalized  Erlang  renewal  arrival  processes 
we  introduce: 

L+,Q+  =  The  number  of  customers  in  the  system  (or  queue)  immediately  after  a  depar- 
ture epoch. 

Lt~ ,  Qt    =  The  number  of  customers  in  the  system  (or  queue)  just  before  a  transition  epoch 
of  the  arrival  process.  A  transition  includes  both  arrivals  in  the  system  and  shifts  to  the 
next  exponential  stage  of  the  ATC.  We  emphasize  that  L^  is  not  the  number  of  customers 
before  an  arrival  epoch.   The  motivation  for  considering  Lf  is  that  using  uniformization 
the  epochs  of  transition  are  Poisson  distributed  and  thus  we  can  apply  PASTA. 
R+  =  The  ATC  stage  immediately  after  a  departure  epoch. 
R^  =  The  ATC  stage  just  before  a  transition  epoch  of  the  arrival  process. 
P+  =  [P{L+  =  n  n  i?+  =  i}%£ ,  P+(z)  =  £~  0  z»P+,  P~  =  [P{Lr  =  n  n*T  =  0]^. 
^(z)  =  E~0z»4r,and   Pn  =  [P{L  =  nnR  =  i}}^,   PL{z)  =  £~0  *nPn- 
We  denote  with  Pq(z),  Pq(z),  and  Pq{z)  the  corresponding  transforms  for  the  number 
of  customers  in  the  queue.    The  vector  distributional  law  is  described  in  the  following 
theorem. 

Theorem  3  (Bertsimas  and  Nakazato  [l])  Under  the  assumptions  of  Theorem  1  and  for 
mixed  generalized  Erlang  interarrival  times  characterized  by  the  matrices  Ao,  Ax, 

Pl(z)  =  P£(z), 

Pq(z)  =  Pq(z), 
PL{z)  =  A(l  -  z)P+(z)(A0  +  zA1)~\  (9) 

PQ(z)  =  A(l  -  z)P+(z)(A0  +  zAx)~\  (10) 


P+(z)  =  ?1'*s{A0  +  zA1), 
P+(z)  =  ?1'$w{A0  +  zA1), 
PL{z)  =  A(l  -  z)ci  '*s(i4o  +  ^i)(Ao  +  z^i)"1,  (11) 

PQ(2)  =  A(l  -  z)ei  '*w(^o  +  2i4,)(i40  +  z^i)-1,  (12) 

where  for  any  matrix  D  we  symbolically  define: 

*s(D)=  f" e-DtdFs(t). 
Jo 

The  kernel  K(z,t)  in  (3)  is  given  by 

K{z,  t)  =  A(l  -  z)it  'e-(A°+zAl»{A0  +  zA^l, 

which  leads  to 

GL{z)  =  A(l  -  z)ei  '*s(A0  +  ^i)(A0  +  zA^t 

Once  again  in  the  case  of  Poisson  arrival  the  vector  forms  reduce  to  scalars  and  we  obtain 

(8). 

3      An  asymptotic  method  of  analysis  for  overtake  free  queue- 
ing  systems 

In  this  section  we  consider  overtake  free  systems  with  general  arrival  processes  that 
satisfy  the  assumptions  of  Theorem  1  and  have  the  property  that  whenever  p  —*  1, 
L,Q,S,  W  — ►  oo,  and  we  propose  a  unified  asymptotic  method  for  the  derivation  of  the 
distributions  of  L,Q,S,  W,  as  well  as  L+  and  Q  +  .  This  section  is  structured  as  follows: 
In  Section  3.1  we  derive  the  asymptotic  form  of  the  distributional  law  while  in  Section  3.2 
we  give  an  asymptotic  generalization  of  the  PASTA  property.  In  Section  3.3  we  present 
the  asymptotic  method  of  analysis  for  overtake  free  system.  Finally,  in  Section  3.4,  we 
implement  this  method  in  specific  examples,  i.e,  GI/G/l,  GI/D/s  and  GI /G/oo  queues, 
to  obtain  new  asymptotic  results. 

10 


3.1      The  asymptotic  distributional  law 

The  important  advantage  of  the  Poisson  arrival  process  is  that  the  kernel  K(z,  t)  in  The- 
orem 2  has  the  very  tractable  form  K(z,t)  =  e-Mi-*)<.  As  mentioned  above,  the  distri- 
butional law  then  becomes  a  relation  among  transforms,  i.e.,  Gl{z)  =  0s(A(l  -  z)).  For 
mixed  generalized  Erlang  arrivals  K(z,t)  is  given  explicitly  in  Theorem  3.  For  arbitrary 
renewal  arrivals,  however,  K(z,  t)  is  not  known  in  closed  form.  In  order  to  exploit  the  dis- 
tributional laws  we  try  to  understand  in  this  section  the  asymptotic  behavior  of  K(z,t). 
For  systems  in  heavy  traffic  (p  — »  1)  both  L,  Q,  5,  W  tend  to  infinity  (we  need  to  exclude 
systems  with  deterministic  arrivals  and  deterministic  service,  i.e  D/D/l).  As  a  result,  we 
are  interested  in  the  behavior  of  K(z,t),  K0(z,t)  as  <  -too  and  z    — >    1. 

Theorem  4  Asymptotically,  as  t  — ►  oo  and  z  — >  1  the  kernels  in  Theorem  2  behave  as 
follows: 

A'(z,r)~e-"<*>, 


and 


where 


K0(z,t)  ~  [1  -  \(1  -  z){c\  -  1)  +  0((1  -  z)2)]e-"W, 


/(;)  =  A(l-z)-iA(l-z)2(c*-l), 
and  c\  is  the  square  coefficient  of  variation  of  the  interarrival  process. 

Proof 

From  (7)  by  writing  K*(z,  s)  =  j&'L  and  expanding  N(z,  s),  D(s,  z)  as  a  Taylor  series 
up  to  second  order  terms  in  s  (note  that  t  — *  oo  in  the  time  domain  is  equivalent  to 
s    — >    0  in  the  transform  domain)  we  have 

x       2a(0)z  -  A(l  -  r)a(O)  +  [za(0)  -  xV-*)EW]s  +  0(s>) 
(Z,S>-  {,  -  *>)(*  -  s2)z&(0) 

where  the  Taylor  series  expansion  of  the  smaller  root  si  in  terms  of  (1  —  z)  is 
Sl  =  _A(l  -  Z)  +  \\{\  -  z)\c\  -  1)  +  0((1  -  z)3), 

11 


o(0) 

Using  a  partial  fraction  expansion  we  invert  in  the  time  domain.  Since  we  are  interested 
in  the  behavior  as  t  — ►  oo  only  the  smaller  root  s\  will  be  asymptotically  important.  As 
a  result,  after  some  tedious,  but  straightforward  manipulations  we  obtain  that 

K(z,t)~{l  +  0{l-z)2)e'*\ 

i.e., 

K(z,t)  ~  (1  +  0(1  -  2)2)c-'(Mi-«)-*Mi-«)V.-D). 

In  a  similar  way,  by  expanding  K*(z,s)  as  a  Taylor  series  in  terms  of  s  and  inverting  in 
the  time  domain  keeping  only  the  most  important  term  asymptotically,  we  obtain  that 

K0(z,t)  ~  [1-  i(l  -  z)(c2a  -  1)  +  0((1  -  *)*)]e-*<*<i-«)-*Mi— Ptt-iM.n 

Combining  Theorems  3  and  4  the  asymptotic  form  of  the  distributional  Little's  law  be- 
comes 

Theorem  5  In  a  queueing  system  that  satisfies  the  assumptions  of  Theorem  1  and  as- 
suming that  as  p  — >  1,  L,  Q,  5,  W  — *  oo  the  following  asymptotic  relations  hold  as  p  — ►  1: 

GL(z)~Mf(*)),  (13) 

<?g(*)~M/(*)).  (14> 

<?*+(*)  ~  [1  -  \{l  -  *)(<£  -  i)]*s(/(*)).  (15) 

GQ+(^)  ~  [1  -  i(l  -  z){c\  -  l)}4>w(f(z)),  (16) 


with 


f(z)  =  \{l-z)-l-\{l-z)\cl-l). 


Proof 

Substituting  in  (3), (5)  and  (4),  (6)  the  asymptotic  form  of  K(z,t)  and  K0(z,t)  from  the 
previous  theorem  we  obtain  (13),  (14)  and  (15),  (16),  respectively.  □ 
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Although  only  valid  asymptotically,  (13),  (14)  and  (15),  (16)  are  very  useful  since  they 
are  relations  among  transforms,  which  we  will  further  exploit  in  the  section.  Also,  the 
previous  expressions  are  exact  for  the  Poisson  case  {c\  =  1).  In  order  to  develop  some 
further  insight  on  the  asymptotic  expressions  of  Theorem  5  we  consider  the  case  of  Ei 
arrivals,  i.e.,  a(s)  =  (yf^;)2-  Then, 

K(z,t)  =  (1  +  >A)2c-2A(i-^)t  _  U-  V^")2c-2A(i+^)t^ 


and 


K  (z   t)  =  (!  +  >/*)    -2A(l-VS)f  _  (1  -  y/z)       2X(l+^)t 


As  z  — >  1  only  the  first  of  the  two  exponentials  contributes  to  K(z,  t),  Ka(z,  t).  Expressions 
(13)  and  (15)  are  the  Taylor  series  expansions  of  the  first  exponential  in  terms  of  1  —  z. 

3.2      An  asymptotic  generalization  of  PASTA 

Theorem  5  leads  to  an  interesting  generalization  of  PASTA  in  systems  in  heavy  traffic. 
Consider  a  queueing  system  that  satisfies  the  assumptions  of  Theorem  1.  Since  in  such 
systems  the  number  of  customers  in  the  system  always  changes  by  one  (for  example  a 
GI/G/s  queue),  L+  =  L~  in  distribution.  In  the  case  of  Poisson  arrivals,  PASTA  implies 
that  L~  =  L  in  distribution.  For  general  arrival  processes  the  distribution  of  L~  depends 
on  the  queueing  discipline,  while  the  distribution  of  L  does  not.  In  heavy  traffic  (p  — ►  1), 
however,  where  Theorem  5  is  applicable  we  have  that 

GL-(z)  =  GL+(z)  ~  GL{z)[l  -  i(l  -  z)(cl  -  1)].  (17) 

In  particular  the  first  moments  are  related  by 

jb[i-]  ~  *[£]  +  dzi, 

which  means  that  in  heavy  traffic,  where  both  E[L~],  E[L]  are  very  large,  their  difference 
asymptotically  depends  only  on  the  coefficient  of  variation  of  the  arrival  process.  Appar- 
ently, a  relation  similar  to  (17)  holds  for  the  number  of  customers  in  the  queue  by  a  similar 
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reasoning.  We  remark  that  we  need  that  L~ ,  L  (or  Q~ ,  Q)  go  to  infinity  as  />  — »  1.  For 
example,  in  a  D/D/l  queue,  even  if  ^  — ►  1,  (17)  does  not  hold,  since  L~ ,  £  (and  (?~,  (?) 
remain  bounded  and  therefore  the  assumptions  of  Theorem  4  are  not  valid. 

3.3      An  asymptotic  method 

Theorem  5  as  well  as  (17)  provide  us  with  the  necessary  analytical  tools  to  form  a  unified 

method  that  solves,  asymptotically,  overtake  free  systems. 

Let  L,  Q  be  the  number  of  customers  in  the  system  and  queue  respectively,  and  S  and  W 

be  the  time  spent  in  the  system  and  queue.  Let  the  random  variable  X  denote  the  service 

time  and  let  also  L+  (Q+)  be  the  number  of  customers  in  the  system  (or  in  the  queue) 

just  after  a  departure.    We  can  describe  the  proposed  method  in  an  algorithmic  way  as 

follows  : 

Asymptotic  method  of  analysis 

1.  Relate  the  transforms  of  L  and  S,  using  the  asymptotic  form  of  the  distributional 
law  (13). 

2.  Relate  the  transforms  of  Q  and  W ,  using  the  asymptotic  form  of  the  distributional 
law  (14). 

3.  Relate  the  transforms  of  S  and  W  using  the  fact  that  S  =  W  ©  X . 

4-   Relate  the  transforms  of  L  and  Q  using  the  characteristics  of  the  system  (see  Section 
3.4  for  further  details). 

5.  Solve  the  4x4  system  of  equations  from  the  previous  4  steps  to  find  the  transforms 
of  L,  Q,  S  andW. 

6.  Using  the  asymptotic  generalization  of  PASTA,  (17),  find  the  transforms  of  L+  and 
Q +  from  the  transforms  of  L  and  Q  . 
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3.4      Applications  of  the  asymptotic  method 

The  GI/G/1  and  GI/D/s  queues 

As  a  first  application  we  consider  a  GI/G/1  queue  with  a  FIFO  service  discipline.   Let 

1/A,  £[A"],  c\,c\  be  the  means  and  the  square  coefficients  of  variation  for  the  interarrival 

and  service  time  distributions.   Let  <fix{s)  be  the  Laplace  transform  of  the  service  time 

distribution. 

Theorem  6  In  a  GI/G/1  queue  under  FIFO  as  p  — >  1  the  Layla.ce  transform  of  the 
waiting  time  distribution  and  the  z-transform  of  the  number  of  customers  in  the  queue  are 
given  by: 

^(5)  -     MsFTW)  '  (18) 


and 


r  (,\   -    (1~2)(1  ~P)  tia\ 

GQ{Z)    ~     *x{f{z))-z>  (19) 


where  f(z)  =  A(l  -  z)  -  \\{1  -  x)\t*  -  1). 

Proof 

The  distributional  law  holds  for  both  L  and  Q.    Performing  the  two  first  steps  of  the 
asymptotic  method  we  obtain  from  (13)  and  (14),  as  p  — »  1  : 

GL(z)  =  M/(*)), 

Gq(z)  =  <f>w(f(z)). 
Performing  the  third  step,  since  S  —  W  ©  X  and  W,  X  are  independent  we  obtain 

<i>s{f(z))  =  4>w{f{z))4>x{f{z)). 

Finally,  performing  the  fourth  step,  we  obtain  the  relation  of  the  generating  functions  of 
I,  Qis 

GL(z)  =  (l-z)(l-p)  +  zGQ(z). 

The  previous  equations  form  a  system  of  four  equations  with  four  unknowns.  By  setting 
s  =  f(z)  and  thus  z    =  f~l{s)  and  solving  the  system  of  equations  we  obtain  (18)  and 
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(19),  as  well  as  the  transforms  of  the  system  time  and  the  number  of  customers  in  the 

system.  □ 

Remarks: 

1.  Using  (17)  we  can  also  find  G^(z)  or  Gq+(z)  as  p  — ►  1. 

2.  In  the  case  of  Poisson  arrivals,  it  is  important  to  notice  that  (18),  (19)  are  exact  and 
generalize  the  well  known  Pollaczek-Khinchin  formulae  for  the  M/G/l  queue. 

3.  By  expanding  <j>w(&)  in  powers  of  a  we  obtain 

<t>w(a)    =    1  -  •» 2\{\-    ) +  °(J)> 


with 


A     =      lr(l-^)2  P4(l+^)2         2P2(1-Cp(l  +  Cl), 


VX2{l-p)2       A2(l-/>)2  A2(l-p)2 

Then,  as  p  — *  1 

and 

JS[^2]  =  2,4. 

As  a  result,  the  coefficient  of  variation  of  W  tends  to  one  as  p  — >  1,  which  is  consistent 
with  the  diffusion  approximation  for  the  waiting  time  in  a  GI/G/1  queue,  i.e.,  W  is 
exponentially  distributed  in  heavy  traffic. 

4.  The  previous  results  for  the  GI/G/1  system  can  also  be  used  in  a  GI/D/s  queue. 
Since  the  service  times  are  deterministic,  every  s  customers  are  served  by  the  same 
server.  Therefore,  as  it  is  well  known,  each  customer  sees  a  GI^''/D/l  queue,  where 
<?/<')  is  the  5  fold  convolution  of  the  interarrival  distribution.  As  a  result,  the  waiting 
time  in  queue  in  the  GI/D/s  queue  is  the  same  as  in  the  GI^/ D/l  queue. 

The  GI/G/  oo  queue 

We  now  apply  the  asymptotic  method  to  find  approximate  closed  form  expressions  for  the 

variance  of  the  number  in  a  GI/G/  oo  system. 
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Theorem  7  In  a  GI/G/oc  queue  in  heavy  traffic  conditions  (E[X]  — ►  oo^ 
GL(z)  »  e-Mi-*)£[*]+*Mi-*)3(d-i)/0°°*/i(*)<i*5 

E[L]  =  A£[X], 


and 


Var[L]  n  AJ5[X]  +  (c*  -  1)  /°°  a;/|(z)<fx. 

Jo 


Proof 

In  a  GI/G/oc  system  the  distributional  law  doesn't  hold  because  Assumption  2  in  Theo- 
rem 1  is  violated  (i.e.,  the  system  allows  overtaking).  In  the  special  case  of  the  GI/D/oo 
queue,  however,  the  distributional  law  does  hold  because,  due  to  the  deterministic  service 
distribution,  the  customers  exit  the  system  in  the  order  they  arrived.  Thus  we  can  write 

l  i  n:(S). 

Moreover,  because  of  the  presence  of  infinite  number  of  servers  there  is  no  waiting  and 
thus  5  =  X,  i.e.,  the  time  in  the  system  is  exactly  the  service  time.  But,  the  pdf  of  X  is 
fx(t)  =  6(t  -  E[X})  and  thus  from  (2) 

GL(z)  =  K(z,E[X}).  (20) 

We  will  now  decompose  the  GI/G/oo  system  into  a  number  of  GI/D/oo  systems.  Suppose 
that  instead  of  having  a  general  service  distribution  the  service  time  is  P{X  =  Xj}  = 
Pji  3  —  l,-..,fc-  The  customers  with  service  times  Xj  can  be  treated  as  a  separate  class 
Cj  of  customers  with  arrival  process  being  a  renewal  process  with  Laplace  transform  ctj(s) 

"M = «w  p,  f>'-wu  -  «)'-• = ._,:%„. 

i.e.,  the  arrival  rate  and  coefficient  of  variation  for  class  Cj  customers  is 

Xj  =  \Pj 

c2a.  =  l  +  Pj(cl-l). 
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If  Lj,  j  =  1,. . .,  k  is  the  number  of  class  Cj  customers  in  the  system,  then 

3  =  1 

The  random  variables  Lj  are  not  independent  since  the  arrival  processes  are  not  inde- 
pendent (in  the  special  case  of  Poisson  arrivals  they  are  indeed  independent).  Using  the 
approximation  that  they  are  indeed  independent  we  obtain 

GL(z)*f[GL](z). 

Each  class  Cj  sees  an  GI /D/oo  for  which  the  distributional  law  holds.  Then  applying 
(20) 

GLj{z)  =  K{z,zj). 

For  large  Xj  the  asymptotic  form  of  the  distributional  law  of  Theorem  4  is  valid  and  thus 

Therefore, 

GL{z)  ~  €-X{1-')^"^p'''  +  ^X(1-z)2{cl-'l)^^p'x'. 

Since  any  general  service  distribution  is  the  limit  of  a  sequence  of  mixtures  of  deterministic 
distributions  we  obtain  that: 

GL(z)  ~  e-^1-2^^^?^1-2'2^-1)^00^^)^, 

which  leads  to 

E[L]  =  \E[X], 

and 

Var[L]ss  XE[X]  +  {c\  -  1)  f°°  xf\{x)dx.u 

Jo 

Remark:  For  the  case  of  Poisson  arrivals  (c\  =  1)  the  expressions  of  the  previous  theorem 
are  exact  leading  to  the  well  known  result 

gl{z)  =  e-Mi-*y*m, 

i.e.,  L  has  a  Poisson  distribution  with  rate  A2?[.Y]. 

18 


4     An  exact  method  of  analysis  for  overtake  free  systems 


In  this  section  we  focus  our  attention  on  overtake  free  systems  with  mixed  generalized 
Erlang  (MGE)  arrival  processes  that  satisfy  the  assumptions  of  Theorem  1  and  we  describe 
a  unified  exact  method  to  obtain  the  distributions  L,  Q,  5,  W,  L+,  and  Q  + .  We  will  use  the 
notation  of  Section  2.2.  In  order  to  accomplish  our  goal  we  first  derive  a  relation  between 
L+  and  Q+,  from  first  principles.  Then,  in  subsection  4.1,  we  present  the  exact  method 
in  an  algorithmic  form  and  finally  in  subsection  4.2  we  illustrate  the  method  in  the  case 
of  MGEm/G/1  and  MGEM/D/s  queues  under  FIFO. 

Proposition  1  Under  the  assumptions  of  Theorem  1  and  for  mixed  generalized  Erlang 
interarrival  times  characterized  by  the  matrices  Ao,  A\, 

P£(z)  =  P£(z)*x(Ao  +  zAl).  (21) 

Proof 

Conditioning  on  the  length  of  the  queue  and  the  ATC  stage  just  after  a  customer  leaves 
the  queue  and  enters  service  we  obtain  for  n  >  1 

n       M  -oc 

P{L+  =n,R+=i}  =  Y,Yl  PiQ+  =k,R+  =  ™}  am(t)  *a^-k~^(t)  *a\(t)  dFx(t) 

fc=Om  =  l  J° 

(22) 
And  for  n  =  0  : 

P{L+  =0,R+  =  i}=J2  HQ+  =  0,iZ+  =  m}  /     aUt)  dFx(t) 

For  every  pair  of  matrices  C  of  full  rank  and  D  of  rank  1, 

C-^DC'1 


(C  +  D)-1    =   C 


-l 


1  +  trace(C-1D) 


Therefore, 


(Is  +  Ao  +  zAi)-1  =  (Is  +  A0)-1  + 


1  -  201(5) 


ai(«)o*i'(a) 

aM(s)ai'(s) 
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which  expressed  in  real  time  gives 

'  a\(t)     ...    <(i) 
e-(Ao+zA!)t  _  :        ..  ; 

0       •••    a%{t) 


+£*n 


n=l 


/    O!(0     \ 


^  a\l(t)  y 


(23) 


Taking  generating  functions  in  (22)  and  using  (23)  we  prove  (21).  □ 

Remark  : 

Equation  (21)  also  follows  from  Theorem  3.    The  reason  we  have  included  a  separate 

proof  is  that  often  in  more  general  systems  (like  priority  systems  in  Section  6)  we  need  to 

generalize  Proposition  1. 

4.1      An  exact  method 

Theorem  3  and  Proposition  1  enable  us  to  present  an  unified  exact  method  for  solving 
overtake  free  systems  with  MGE  arrivals  under  the  assumptions  of  Theorem  1.   We  will 
use  the  notation  of  Section  2.2. 
Exact  method  of  analysis 

/.   Relate  the  transforms  PL+   and  Pi  using  (9). 

2.  Relate  the  transforms  Pq+  and  Pq  using  (10). 

3.  Relate  the  transforms  PL+  and  Pq+  using  (21). 

4.  Relate  the  transforms  of  Pi  and  Pq  using  the  characteristics  of  the  system  up  to 
constant  terms  and  use  Little's  law  to  evaluate  the  constants  (see  Section  4-2  for 
further  details). 

5.  Solve  the  4  X  4  system  of  equations  from  the  previous  4  steps  to  find  Pi,  Pq,  P^+ 
and  Pq+  • 

6.  Find  the  transforms  of  S,  and  W,  from  (11)  and  (12). 
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We  are  going  to  illustrate  how  the  method  works  through  an  application  in  the  next 
subsection. 

4.2      The  MGEm/G/I  and  MGEM/D/s  queues  under  FIFO 

We  consider  in  this  subsection  a  MGEm/G/I  queue,with  a  FIFO  service  discipline  where 
the  arrival  process  is  a  generalized  Erlang  process  characterized  by  the  matrices  Aq  and 
j4i.  Let  a(s)  —  aNy)  be  the  Laplace  transform  of  the  interarrival  distribution  where 
Q£>(j),  ctj^(s)  are  polynomials  of  degree  M  and  less  than  M  respectively. 

Theorem  8  In  a  MGEm/G/I  queue  under  FIFO 

PQ(z)   =   (l-z)M(*x{A0  +  zA1)-zI)-1,  (24) 

PL(z)   =    (1  -  x)M{*x{Aq  +  zAt)  -  z/)-1  *X{Ao  +  zAi),  (25) 

and 

where  xr,  r  =  1, . . . ,  M  —  1  are  the  M  —  1  roots  of  the  equation 

a(-s)4>x(s)  =  1,    Re{s)>0, 
and  H  is  an  M  vector  whose  ith  component  is 

Hi  =  -(1  -  \iPiE[X])  f[(l  -  Pfe).  (27) 

A'  fc=i 

Proof 

Since  this  system  is  overtake  free  we  will  use  the  exact  method  of  analysis  described  in 
the  previous  subsection.  Thus,  performing  the  first  two  steps  of  the  exact  method  we  use 
(9)  and  (10)  and  we  obtain: 

PL{z)  =  A(l  -  z)P£(z)(A0  +  zAxy\ 

p-Q(z)  =  \(l-z)P+(z)(A0  +  zA1)-\ 
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Combining  the  previous  two  equations  with  (21),  third  step,  we  obtain,  since  the  matrices 
$A'(-4o  +  zA\),  (A0  +  zAi)~l  commute, 

?l(*)   =   Pq(z)^x(A0  +  zA1).  (28) 

Applying  the  fourth  step,  the  number  of  customers  in  the  queue  and  the  number  of  cus- 
tomers in  the  system  are  also  related  as  follows 

PL(z)  =  (1  -  z)H  +  zPQ(z),  (29) 

where  H  is  an  M- vector  with  Ht  —  P{L  =  0,R  —  i}. 
Combining  (28)  and  (29)  we  obtain  (24)  and  (25). 
To  complete  the  fourth  step  we  next  compute  H. 

Hi  =  P{L  =  0,R  =  i}   =   P{L  =  0\R  =  i}P{R  =  i}. 

Applying  the  usual  Little's  law  to  the  server  we  find  that: 

1  -  P{L  =  0\R  =  i}    =    (\iPi)E[X}. 

In  order  to  compute  P{R  —  i}  we  represent  the  ATC  as  a  continuous  time  Markov 
chain  with  M  states  as  shown  in  Figure  2.  Solving  for  the  9teady-state  distribution  we 
obtain 

P{R  =  i}  =  ±lf[(l-Pk),  (30) 

and  thus 

H{  =  ±{l-\uHE[X])l[(l-pk). 

A«  fc=i 

At  this  point  we  have  solved  exactly  for  Pl(z)  and  Pq(z)  (fifth  step).  In  order  to  find 
the  transform  of  the  waiting  time  distribution  (sixth  step)  we  combine  (12)  and  (24)  and 
obtain 

ej  '*w(Ao  +  zAx)(*x(Ao  +  zAx)  -  zl)  =  jH(A0  +  zAx).  (31) 

We  now  choose  a  z  such  that  Ao  +  zAi  has  M  linear  independent  eigenvectors  and  thus 
it  can  be  written  as: 

A0  +  zAx    =   S{z)Q(z)S-1{z), 
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Figure  2:  The  Markov  chain  of  the  ATC 

where  0(z)  is  the  diagonal  matrix  of  the  eigenvalues  of  A0  +  zA\  which  we  denote  by  9i(z) 
for  i  =  1, . . .,  M.  Bertsimas  and  Nakazato  [2]  have  shown  that  the  roots  of  the  equation 
satisfy: 

za(-$i{z))  =  1,  i'  =  l,...,M. 

The  columns  of  S(z)  are  the  right  eigenvectors  of  A0  +  zA\  which  we  denote  by  £(0,(z)). 
Moreover, 

$W(A0  +  zAx)  =  S(z)$w(Q(z))S-l(z), 

$x(A0  +  zA1)-zI  =  S(z)(*x(Q(z))  -  zI)S~l{z), 
and  substituting  to  (31)  we  obtain 

e\  'S(z)iw(Q{z))(*x(*(*))  ~  zl)  =  jl}S(z)Q(z) 


or 

<hv(ei(zml{91(z)){<l,x(01{z))  -z)=  jMfaizWiiz), 

with  £i(#i(z))  being  the  first  component  of  £(#i(z))  (the  previous  relation  also  holds  for 
every  eigenvalue  0,(z),  i  =  1 . .  .  M).  Since  za{-9{{z))  =  1  we  have 

9Wy   U    "  A(a(-01(z))fo(6>1(z))-l)Sl   U    »' 
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where  the  function  g{9\ (z))  must  have  an  appropriate  form  in  order  to  maintain  the 
analytical  character  of  <f>w(6i{z))-  Therefore, 

4>w(s)  =  K  9a!,~3(\      u9(s).  (32) 

X(a{-s)<f>x{s)-  1) 

Since  <t>w{&)  is  analytic 

where  xr,  r  =  1, . . .,  M  —  1  are  the  M  —  1  roots  of  the  equation 

a(-s)<j>x(s)  =  1,    Re{s)  >  0. 

and  K  is  a  constant  such  that  : 

»— »o 
which  leads  to  (26).   □ 
Remarks: 

1.  Equation  (24)  is  to  the  best  of  our  knowledge  new,  while  (26)  is  a  generalization 
of  the  Pollaczek-Khinchin  formula  for  the  M/G/l  queue.  It  is  interesting  to  notice 
that  (26)  could  have  been  obtained  using  Hilbert  factorization  techniques.  It  is 
remarkable  that  we  were  able  to  derive  these  formulae  just  from  the  distributional 
laws. 

2.  The  previous  results  for  the  MGEm/G/1  system  can  also  be  used  in  a  MGEm/ D/s 
queue  (see  Remark  4  after  Theorem  6). 

5     The  GI/G/1  queue  with  generalized  vacations 

In  this  section  we  consider  a  class  of  GI/G/1  queueing  models  with  a  single  server  who 
is  unavailable  for  occasional  intervals  of  time.  Whenever  the  server  is  either  unavailable 
or  idle  we  say  that  he  is  "on  vacation".    Formally  the  GI/G/1  queue  with  generalized 
vacations  is  denned  as  follows: 
GI/G/1  with  generalized  vacations 
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Gl.  The  system  satisfies  the  assumptions  of  Theorem  1.  In  particular,  as  long  as  the 
server  is  busy,  customers  are  served  in  a  non-preemptive  FIFO  order. 
G2.  The  service  mechanism  need  not  be  exhaustive.  When  the  server  begins  his  vacation 
he  may  leave  customers  behind  depending  on  the  service  mechanism.  We  denote  by  Zq 
the  number  of  customers  present  in  the  system  in  steady  state  when  a  vacation  interval 
starts.  Zo  is  determined  by  the  service  mechanism. 

G3.  Each  vacation  interval  is  distributed  as  a  random  variable  V  and  has  Laplace  trans- 
form <j>\r(s).  We  assume  that  the  number  of  arrivals  during  V  is  independent  of  Zq. 

This  system  is  a  generalization  of  the  GI/G/1  queue  with  exhaustive  vacations  consid- 
ered in  Doshi  [4],  in  which  Z0  =  0.  It  also  generalizes  the  M/G/l  system  with  generalized 
vacations  considered  in  Fuhrmann  and  Cooper  [5]  (see  also  the  discussion  in  Wolff  [17], 
p. 457)  in  the  sense  that  it  allows  more  general  arrival  processes.  In  some  of  their  results 
Fuhrmann  and  Cooper  [5],  however,  relax  Assumption  G3  above,  allowing  the  vacation 
time  to  depend  on  the  arrival  process.  In  order,  however,  to  prove  sharper  decomposition 
results  they  make  exactly  the  same  assumption  (their  Assumption  6).  Our  results  also 
generalize  the  results  of  Keilson  and  Servi  [11]  in  two  respects:  They  consider  Poisson 
arrivals  and  assume  exhaustive  service  Zq  =  0. 

Our  goal  in  this  section  is  to  illustrate  a  unified  way  based  on  the  distributional  laws 
to  solve  queues  with  generalized  vacations  based  on  the  exact  method  of  analysis  from 
Section  4.1.  Corollaries  of  our  results  include  the  decomposition  results  established  in  [4], 
[5]  and  [11].  In  this  way  we  obtain  insights  on  the  extend  to  which  the  decomposition 
results  depend  on  the  Poisson  assumption. 

Examples  of  the  class  of  GI/G/1  queues  with  generalized  vacations  that  we  consider 
in  this  section  include: 

1.  The  standard  GI  /G/l  queue,  if  all  vacations  correspond  to  idle  periods  (i.e.,  V  — »  0). 

2.  The  GI  /G/l  queue  with  exhaustive  vacations,  in  which,  whenever  the  server  is  busy, 
he  serves  the  system  exhaustively,  i.e.,  Z0  =  0. 
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3.  The  GI/G/1  queue  with  gated  vacations,  in  which  the  server  accepts  only  those 
customers,  who  were  waiting  when  the  server  returned  from  vacation,  i.e.,  Zq  is  dis- 
tributed according  to  the  number  of  customers  who  arrived  after  the  server  returned 
from  vacation. 

4.  The  GI/G/1  queue  with  limited  service,  in  which  the  server  serves  up  to  k  customers 
in  each  visit  and  then  takes  a  vacation. 

5.  Queues  served  in  cyclic  order  considered  in  Fuhrmann  [6].  The  vacations  associated 
with  any  particular  queue  correspond  to  times  when  the  server  is  visiting  the  other 
queues. 

5.1      Analysis  of  MGEm/G/1  queue  with  generalized  vacations 

We  consider  the  system  in  steady  state  and  we  let  Lv,  Qv,  and  R„  be  the  number  of 
customers  in  the  system,  the  number  of  customers  in  the  queue  and  the  ATC  stage  of  the 
arrival  process  respectively,  when  a  random  observer  observes  the  system  with  generalized 
vacations.  Let  V*  be  the  elapsed  time  since  the  last  vacation  began  (the  forward  recurrence 
time  of  V).  Let  B  the  event  that  the  server  is  busy  at  the  time  of  observation.  Obviously 
B'  is  the  event  that  the  server  is  on  vacation  at  the  time  of  observation. 

Let  R0  and  Zq  to  be  the  ATC  stage  of  the  arrival  process  and  the  number  of  customers 
present  in  the  system,  when  a  vacation  interval  starts.  We  define 


C„  =  [P{Z0  =  nHR0  =  m\B'}]Z=1  and    fo)  =  £  z"<fn 


We  view  the  vector  generating  function  £(z)  as  defining  the  service  mechanism.  Our  main 
theorem  is  as  follows: 

Theorem  9  In  an  MGEm/G/1  system  with  generalized  vacations  satisfying  Assumptions 
Gl  -  G3  that  has  mixed  generalized  Erlang  interarrival  times  characterized  by  matrices  Aq 
and  Ai ,  vacations  distributed  according  to  the  random  variable  V  and  service  mechanism 
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characterized  by  the  vector  generating  function  £(z)  the  vector  generating  function  of  the 
number  of  customers  in  the  queue  and  in  the  system  is  given  by 

PQv(z)  =  (l-p)  C(z)  *v(Ao  +  zAx)(l  -  z)  {*x(Ao  +  zA1)-  zl)~\  (33) 

PlA*)  =  (1~P)  fc)  *v(A0  +  ^i)(l  -  z)  ($X(A0  +  zA1)-  zI)-l*x{A0  +  zAx).  (34) 

Proof 

Let  Sv,  Wv,  X  be  the  system,  waiting  and  service  time  of  a  customer.  Let  p  be  the  traffic 
intensity.  Because  of  Gl  using  the  exact  method  of  analysis  for  overtake  free  systems  and 
applying  (28)  for  Qv  and  Lv  we  obtain 

PlAz)  =  PqAz)*x(A0  +  zA1).  (35) 

Our  goal  is  to  establish  another  relation  between  Plv(z)  &nd  Pqv(z).  Consider  a  random 
observer  of  the  system.  Recall  that  B  is  the  event  that  the  server  is  busy  and  B'  is  the 
event  that  the  server  is  on  vacation,  at  the  time  of  observation.  By  applying  Little's  law 
to  the  server  P{B}  =  p  and  P{B'}  =  1  —  p.  By  conditioning  on  the  event  B  we  obtain 

P{QV  =  n,Rv  =  i}  =  pP{Qv  =  n,Rv  =  i\B]  +  (1  -  p)P{Qv  =  n,  Rv  =  i\B'},        (36) 

Conditioning  on  Zo,  Ro,  V*  we  obtain 

P{QV  =  n,Rv  =  i\B'}  = 

M       n         .„„ 

-     EE/      P{Qv  =  n,Rv  =  i\B',V*  =  t,Zo  =  m,R0  =  k} 

fc=lm=Oy° 

P{Z0  =  m,  R0  =  k,  V  =  t\B'}dt 

M     n-l  oo 

=     y^Y.  P{Z0  =  m,  R0  =  k\B'}  /      ak(t)  *  a^n-m-l\t)  *  a\(t)  dFv.(t) 

fc=l  m=0  J° 

+  T\  P{Z0  =  n,  R0  =  k\B'}  /      ai(t)dFv.(t),  (37) 

where  we  used  the  independence  of  V*  and  (Zq,Ro)  (Assumption  G3  in  the  definition 
of  queues  with  generalized  vacations).  Let  B(z)  =  \^^-oP{Qv  =  n,  Rv  =  i\B}zn)™_l  . 
Taking  generating  functions  in  (36)  and  using  (23)  to  (37),  we  obtain 

PqM  =  pB{z)  +  (1  -  p)  C(z)  *V.{A0  +  zAx). 
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Similarly 

P{LV  =  n,Rv  =  i}  =  pP{Qv  =  n-lDRv  =  i\B}  +  (1  -  p)P{Qv  =  nf)Rv  =  i\B}, 

from  where,  by  taking  generating  functions,  we  obtain 

PLv(z)  =  pzB(z)  +  (l-p)  ((z)  #v.(i40  +  zAt). 

Therefore, 

PlAz)  =  *PqA*)  +  (1  -  *)(1  -  P)  fc)  *v(Ao  +  zAx),  (38) 

which  combined  with  (35)  gives  (34)  and  (33).     □ 
Remarks: 

1.  Equation  (34),  as  well  as  (33),  is  not  formally  a  decomposition  result.  It  demon- 
strates, however  the  contributions  of  the  various  characteristics  of  the  system  to  the 
system  length  distribution.  The  first  term  £(z)  represents  the  effect  of  the  service 
mechanism  used.  The  second  term  $v(A0  +  zA-[)  represents  the  effect  of  the  va- 
cation, while  the  third  term  (1  -  p)(l  -  z)  ($jr(A0  +  zAi)  —  zl)~l  $x(j40  +  *A\) 
represents  the  contribution  from  the  underlying  MGEm/G/1  queue  without  vaca- 
tions. 

2.  In  the  case  of  Poisson  arrivals  we  obtain 

PLv(z)  =  C{z)  4>v.{\  -  Xz)  MX_Xz)_z . 

which  is  a  formal  decomposition  result  obtained  in  Fuhrmann  and  Cooper  [5].  The 
number  of  customers  in  the  system  is  distributed  as  the  sum  of  three  independent 
random  variables:  (1)  The  number  of  customers  that  are  left  in  the  system  when 
a  vacation  begins,  (2)  the  number  of  customers  that  arrive  in  the  system  during 
a  vacation  period,  and  (3)  the  number  of  customers  in  a  M/G/l  queue  without 
vacations.  A  similar  relation  is,  obviously  obtained  for  the  queue  length  distribution. 
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3.  Assumption  G3  was  only  used  in  deriving  (37).  Without  Assumption  G3,  instead  of 
(38)  we  would  obtain 

Plv(z)  =  zPQv(z)  +  (1  -  z)(l  -  p)PL,\B,(z),  (39) 

where  Pl,\B'(z)  1S  the  vector  generating  function  of  the  number  in  the  system  given 
that  the  server  in  on  vacation.  Combining  (39)  with  (35)  we  obtain 

PlAz)  =  Plt\b-(z)(1  -  p)  (1  -  z)  (§jr(A0  +*Ai)  -  zI)-l*x{Ao  +  »iti), 
which  is  the  generalization  of  Proposition  5  in  Fuhrmann  and  Cooper  [5]. 

5.2      Applications  of  the  MGEm/G/1  with  generalized  vacations 

In  the  previous  subsection  we  have  been  able  to  derive  a  formula  for  the  number  of  cus- 
tomers in  the  system  and  in  the  queue  for  a  MGEm /G/l  queue  with  generalized  vacations 
as  a  function  of  Q(z).  Thus,  given  that  one  is  able  to  solve  for  C,{z),  the  queue  and  system 
length  distributions  are  fully  characterized  and  from  them  the  waiting  and  system  time 
through  the  distributional  laws.  In  this  subsection  we  will  consider  some  specific  applica- 
tions of  the  previous  analysis  that  have  interesting  consequences. 
The  MGEm/G/1  queue  with  exhaustive  vacations 

For  the  case  of  exhaustive  vacations  Theorem  9  implies  the  decomposition  results  of  Doshi 
W. 

Theorem  10  (Doshi  [4])  For  the  MGEm/G/1  with  vacations  V  under  FIFO,  the  waiting 
time  is  the  sum  of  the  waiting  time  of  a  MGEm /G/l  and  the  forward  recurrence  time  of 
the  vacation  V. 

Proof 

In  this  case  Z0  =  0  and  therefore  ((z)  —  P{Z  =  0,Ro  =  *}«i  =  *i  i-e->  a  vector 
independent  of  z.  Then  (34)  can  be  written  (since  all  the  matrices  commute) 

PLv(z)  =  (1  -  p)  A  (1  -  z)  (*x(A0  +  zAi)-  zI)-^x(A0  +  zAx)  iv.(A0  +  zAx). 
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In  a  regular  MGEm/G/1  queue,  however  (25)  holds,  i.e., 

PL(z)  =  8  (1  -  z)  (*x(Ao  +  *4i)  -  z/)-1**^,,  +  zAx). 

But  Pl.  (1)  =  Pl(1)i  since  the  ith  component  of  each  vector  is  the  probability  that  the 
ATC  is  in  stage  i  which  is  indepedent  of  the  vacation.  Taking  limits  as  z  — >  1  in  the  two 
previous  equations  we  obtain 

Therefore,  in  a  MGEm/G/1  with  exhaustive  vacations 

PLv(z)  =  S  ^.(^o  +  ^i)-1  (1-2)  [$x{A0  +  zAi)  -  zI)-1*x(A0  +  zAr)  ^-(Ao  +  zAr), 

(40) 
where  the  vector  $  is  computed  in  (27).  (40)  offers  a  complete  solution  of  the  MGEm/G/1 
queue  with  exhaustive  vacations. 

Following  exactly  the  same  approach  leading  to  (32)  in  the  proof  of  Theorem  8  we 
obtain  that 

\{a{-s)<f>x{s)  -  1) 


i.e., 


wv  i  w  e  v.  n 


The  MGEm/G/1  queue  with  gated  vacations 

In  a  gated  vacation  system  our  goal  is  to  find  ((z).  For  this  reason  we  define  the  following 
random  variables  : 

Let  J  be  the  time  the  server  spends  in  the  system  immediately  after  he  returns  from 
vacation  until  he  starts  a  new  one.  Let  Fj(t)  =  P{J  <  t}  and  <f>j(s)  be  the  Laplace 
transform  of  J.  Let  Rj  be  the  ATC  stage  of  the  arrival  process  and  N  be  the  number  of 
the  customers  that  the  server  finds  at  the  system  just  after  the  end  of  the  vacation.  We 
define  Rj  =  ?{Rj  =  m}*f=,  and  N{z)  =  E{zN). 
Finally,  we  define  also  the  vectors 
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rfn  =  P{N  =  n  n  Rj  =  m}%=l  and  tf(z)  =  £~=0  znrfn.  Note  that  Rj  =  JV*(1). 

From  the  definition  of  the  service  mechanism  in  a  gated  system,  Zq  is  distributed  according 

to  the  number  of  customers  who  arrived  during  J,  thus  : 

oo 

53  2nP{£o  =  ",  Ro  =  k\Rj  =  m}  = 

n=0 

f"  akm(t)dFj(t)  +  J  Z»  I"  am(t)  *  al-l\t)  *  a\{t)dFj{t), 

J°  n=l         y° 

which  leads  to  : 

oo 

£z"P{Zo  =  n,  £(,  =  *}  = 

/•oo  °°  /-oo 

/      <&(*)<tfj(0  +  £  z"  /      am(0*a<"-1)(0*aJ(t)dFJ(f) 
Jo  ~L       Jo 


n=0 

M 

Y,  P{RJ  =  m} 

m  =  l 


n=l 

which  in  matrix  notation  becomes  : 

C{z)  =  ft(l)*j(A0  +  zA1).  (41) 

Furthermore,  the  time  interval  J  lasts  as  long  as  the  server  is  servicing  the  N  customers 
he  finds  upon  his  arrival.  So 

M»)  =  tf(*r(«))-  (42) 

Finally  we  need  to  evaluate  N(z)  from  the  characteristics  of  the  system.    Recalling  the 

definition  of  the  gated  vacation  system  we  see  that  N  includes  the  customers  that  the 

server  left  behind  in  the  system  before  starting  his  vacation  as  well  as  the  customers  that 

arrived  during  the  vacation  interval.  Therefore  ,  for  n  >  1  : 

n     M  t<x 

P{N  =  n,Rj  =  l}  =  ^  ]>3P{Zo  =  Jfc,.Ro  =  m}  /      am(t)  *  a*"-*"1)^)  *  a[(t)dFv(t). 

Taking  generating  functions  : 

fi(z)  =  <;{z)*v{Ao  +  zA1).  (43) 

By  combining  (41),  (42)  and  (43)  we  have: 

C(z)  =  C*(l)  $V{A0  +  Ay )  *j{A0  +  zAi),  (44) 
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where 

M»)  =  a4>x(s))^v(A0  +  <j>x(s)Al)l.  (45) 

Equations  (44)  and  (45)  fully  characterize  £(z)  as  we  can  solve  for  all  moments.  Moreover 
if  we  use  Theorem  9  and  the  distributional  laws  we  can  fully  characterize  the  system. 
Remark  :  Notice  that  in  the  Poisson  case  the  recursion  formula  takes  the  form 

C(z)  =  C(<M*  -  **))  M*  -  WA  -  Az)). 
6      Priority  queues 

Priority  queues  are  important  in  communication  and  manufacturing  systems  where  jobs 
of  different  significance  need  to  be  serviced.  In  addition,  in  several  applications  strict 
priority  rules  (for  example  the  so  called  c/i-rule)  minimize  a  weighted  combination  of 
expected  waiting  times.  It  is  therefore  important  to  be  able  to  analyze  priority  queues. 

We  consider  single  server  priority  queueing  systems  with  mixed  generalized  Erlang 
arrivals,  in  which  there  are  two  distinct  customer  classes,  numbered  1  and  2.  Customers 
of  class  1  have  priority  over  those  of  class  2.  Let  a(t ),  b(t)  be  the  pdf  of  the  interarrival 
time  for  the  high  priority  class  1  and  the  low  priority  class  2  respectively.  We  assume 
that  they  are  mixed  generalized  Erlangs  of  order  Mi,  M2  respectively.  Let  (Ao,Ai), 
(Bo,  B\)  be  the  corresponding  matrices  for  class  1  and  2  arrivals  respectively.  Then  Aq  + 
zAi  =  Si(z)Ql{z)S{1{z),and  Bo  +  zBi  =  S2(z)Q2 (z)S2~1  (2)  where  0,(z)  is  the  diagonal 
matrix  of  the  eigenvalues  and  Si(z)  is  the  matrix  with  columns  the  right  eigenvectors 
(t  =  1,2).  We  denote  with  1/Ai  and  I/A2  the  means  of  the  arrival  processes.  The  two 
classes  have  different  (general)  service  time  distributions  with  means  E[-X"i]  and  EfXa], 
and  they  are  served  by  a  single  server. 

We  assume  that  within  the  same  class  customers  are  served  in  a  FIFO  order.  Although 
priority  queues  allow  overtaking  among  classes,  within  the  same  class  no  overtaking  can 
take  place  and  therefore  the  distributional  laws  are  applicable.  In  this  section  we  use 
the  distributional  laws  to  derive  the  distributions  of  various  performance  measures.  Our 
results  generalize  earlier  work  of  Keilson  and  Servi  [11]  for  Poisson  arrivals. 
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We  consider  different  types  of  priorities  (preemptive  repeat,  preemptive  resume,  non- 
preemptive).  The  type  of  priority  used  does  not  affect  the  service  time  of  class  1,  but 
affects  the  service  time  of  class  2.  In  order  to  develop  a  generic  model  to  analyze  priority 
queues  in  a  unified  way,  we  define  the  effective  service  time,  Gi,  i  =  1,2,  as  the  time 
from  the  beginning  of  service  until  the  customer  of  class  i  completes  service  (G\  =  X\, 
regardless  of  the  priority  rule  used).  We  can  visualize  the  effective  service  time  as  the  time 
spent  in  a  service  box.  The  service  may  be  interrupted  and  resumed  from  where  it  was 
left  or  may  start  over,  but  the  customer  is  assumed  to  stay  in  the  service  box  until  he  is 
completely  served.  In  this  setting,  the  time  in  queue  refers  to  the  time  from  the  arrival  of 
the  customer  until  the  customer  enters  the  service  box. 

The  section  is  organized  as  follows.  In  Section  6.1  we  generalize  the  classical  results  of 
Takacs  [15]  for  the  M/G/l  queue  for  the  busy  period  distribution  to  a  matrix  form.  This 
generalization,  which  is  also  of  independent  interest,  is  essential  since  the  service  time  of 
class  2  customers  in  a  preemptive  priority  system  depends  on  the  busy  period  distribution 
of  class  1  customers.  In  Section  6.2  we  find  the  effective  service  time  distribution  in 
various  preemptive  systems  as  a  function  of  the  busy  period  matrix.  In  Section  6.3  we 
analyze  systems  with  preemptive  priorities,  while  in  Section  6.4  we  analyze  systems  with 
non-preemptive  priorities. 

6.1      The  high  priority  customers  busy  period  matrix 

We  denote  with  ATC\  and  ATC2  the  two  arrival  timing  channels.  In  this  section  we  will 
compute  the  busy  period  matrix  £1(3)  with  [Ei(a)]jj  =  <Tij(s),  i,j  =  1, .. . ,  Mi  denoting 
the  Laplace  transform  of  a  sub-busy  period  interval  for  class  1  that  ends  with  ATC\  =  j 
given  that  it  started  with  ATC\  —  i.  Note  that  though  a  busy  period  interval  is  initialized 
by  the  first  customer  that  arrives  after  an  idle  interval,  a  sub-busy  period  is  initialized 
whenever  a  customer  enters  service  (see  for  example  Kleinrock  [12]  p.  210)  and  therefore 
at  the  beginning  of  a  sub-busy  period  ATC\  can  be  in  any  stage. 
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Theorem  11  In  a  MGEmJG/1  queueing  system  where  the  interarrival  process  is  char- 
acterized by  the  matrices  Ao  and  A\  and  the  Laplace  transform  of  the  service  time  is 
4>Xi{s)  we  have  that: 


M, 


Si(-)  =  E^x1(*-*iW)fi(*KiW*))i 


where  Xj(s)  are  the  M\  roots  of  the  equation 


a{x)4>Xi{s  -as)  =  1,    Re{x)  <  0  for  Re{s)  >  0, 


and 


li(») 


ZmAs) 


al'(x1(s)) 
a\'{xMl{s)) 


Proof 

We  will  use  a  generalization  of  the  classical  sub-busy  period  decomposition  argument  for 
the  evaluation  of  the  busy  period  for  the  M/G/l  queue  (Takacs  [15]).  The  duration  of 
a  busy  period  is  invariant  under  the  service  discipline  provided  that  the  server  is  always 
busy  if  there  are  customers  present.  We  then  use  the  last-come-first-serve  (LCFS)  service 
discipline.  Let  Bit7n  be  the  duration  of  the  sub-busy  period  for  class  1  customers  that 
ends  with  ATC\  =  m  given  that  it  started  with  ATC\  =  i.  This  definition  is  useful  for 
the  decomposition  of  the  busy  period  into  sub-busy  periods.  Let  i?"'  be  the  ATC\  stage 
occupied  by  the  customer  just  after  the  first  customer  of  the  sub-busy  period  is  served.  Let 
Ni(x)  be  the  number  of  class  1  arrivals  during  x  given  that  ATC\  —  i.  Then,  conditionally 
on  the  event  U  =  {.ft?*  =  j,X\  =  x,  Ni(x)  —  n}  we  obtain  the  following  decomposition, 
for  n  >  1 

E[e-Bi"\R?  =  j,Xi  =  x,  Ni(x)  =  n]  =  E[e~'{x+^ »-  B^+B'^+-+B'-^} 

=  e-"e'i[S1(5)rem. 
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Unconditioning,  we  write  the  previous  relation  in  matrix  form 
a\(x)     ...    «*(*) 


Si(-)  =  J?°e 


00  -,-Ja: 


M 


*MlS*)\ 


dFXl{x)+ 


ai(x)    \ 


+ 


r^"fl  *a[n-x)(x)J  a\(x)  a^(x))[M*)]ndFXl{z). 

J0  n=l  V  ' 

In  order  to  compute  £1(3)  we  will  compute  its  eigenvalues  and  eigenvectors.  Multiplying 
both  parts  of  the  previous  equation  with  ((s),  the  right  eigenvector  of  £1(3)  corresponding 
to  the  eigenvalue  u(s),  and  using  equation  (23)  we  obtain: 


Ei(j){(j)  =  u(s)t(s)  =  *Xl(*I  +  A0  +  u(s)A1)((s). 


(46) 


(Notice  that  for  M\  =  1,  this  reduces  to  cri(s)  =  <f>xt  {s  +  A  -  A<7i($),  which  is  the  equation 
that  the  transform  of  the  busy  period  satisfies  in  a  M/G/l  queue.) 

Therefore  £(s)  must  be  a  right  eigenvector  of  $jv, {'I  +  Ao  +  u(s)Ai)  and  equiva- 
lently  a  right  eigenvector  of  Aq  +  u(s)Ai  with  corresponding  eigenvalue  —x(s).  Bertsi- 
mas  and  Nakazato  [2]  have  shown  that  u(s)a1(a,(3))  =  1  and  furthermore  from  (46) 
u(s)  =  </>_y,  (s  —  x(s)).  Therefore,  the  eigenvalues  Uj(s)  (j  —  1,  ...,M\)  of  £1(3)  are 
computed  as  follows:  Uj(s)  =  <f>Xi(s  —  Xj(s)),  j  =  l,...,Mj  where  Xj ,(s)  are  the  Mi  roots 
of  the  equation 

a(x)<t>Xl(s  -  x)  =  1,    Re{x)  <  0  for  Re(s)  >  0. 

Moreover,  £j(s)  is  the  right  eigenvector  of  Ao  +  ^"^(a  —  Xj(s))Ai  corresponding  to  the 
eigenvalue  -Xj(s).  The  left  eigenvectors  are  computed  in  [2]  and  are  equal  to  ai'(xj(s)). 
Having  characterized  the  eigenvalues  and  eigenvectors  of  £i(s)  we  can  spectrum  de- 
compose it  as  follows: 

Si(a)  =  £  <f>xA»  ~  «i(*))S(*Ki'(«i(«)). 
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where 


i  -i 


di'(«i(*)) 


fi(«)    •••    toA*)  J  =  : 

oi'(*Af,(«)) 
Remark:  The  transform  <Ti(s)  of  the  busy  period  distribution  is  given  by 

<T1(s)  =  e'1E1(3)f. 

6.2      Effective  service  time  distribution  in  preemptive  systems 

According  to  preemptive  disciplines,  whenever  a  high  priority  customer  finds  a  lower 
priority  customer  in  service,  he  interrupts  the  service  in  progress  and  starts  his  own  im- 
mediately. Once  there  is  no  higher  priority  customer  left  in  the  system,  the  interrupted 
customer  reenters  service  and  depending  upon  the  manner  in  which  he  is  serviced  on  his 
reentry,  the  preemptive  discipline  can  be  further  broken  down  into  the  following  three 
categories: 

•  Preemptive  resume  discipline  : 

Under  this  discipline  the  interrupted  customer  continues  his  service  from  the  point 
of  interruption. 

•  Preemptive  repeat  different  discipline  : 

Under  this  discipline  the  interrupted  customer  continues  his  service  by  resampling. 

•  Preemptive  repeat  identical  discipline  : 

Under  this  discipline  the  interrupted  customer  continues  his  service  without  resam- 
pling. 

Each  of  these  three  preemptive  disciplines  is  going  to  affect  the  effective  service  time  of 
class  2  customers.  In  this  section  we  calculate  the  effective  service  time  in  all  the  three 
preemptive  categories  as  a  function  of  the  class  1  busy  period  matrix. 

We  define  random  variables  G^,  i,j  —  1, .. .,  M\,  which  is  the  effective  service  time  of 
a  class  2  customer  such  that  ATC\  =  j  when  the  class  2  customer  finishes  service  given 
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that  ATC\  =  i  when  this  class  2  customer  started  service.    Let  <f>Gij(s)  be  the  Laplace 
transform  of  G'J  and  let  G^l^)  denote  the  matrix  with  elements  <pG„(s).  Our  goal  in  this 
section  is  to  compute  the  matrix  G2(s). 
Preemptive  resume  discipline 

Proposition  2  In  a  single  server  system  with  two  priority  classes  each  of  which  satisfies 
the  assumptions  of  Theorem  1  and  has  mixed  generalized  Erlang  interarrival  times  charac- 
terized by  matrices  Aq,  A\  and  Bo,  B\  respectively,  the  effective  service  time  of  the  class 
2  customers  for  the  preemptive  resume  discipline  is  given  as  follows: 

G2(s)  =  *x2(A0  +  A1i:1(s)  +  sI). 

Proof 

According  to  the  preemptive  resume  discipline,  whenever  a  low  priority  customer  service 
is  interrupted,  the  duration  of  the  interruption  is  exactly  the  duration  of  a  high  priority 
customer  busy  period.  Furthermore,  due  to  the  characteristics  of  the  mixed  generalized 
Erlang  arrival  process  we  condition  on  R\',  the  ATC\  stage  immediately  before  a  low 
priority  customer  enters  service.  Let  <f>Gki{s)  be  the  Laplace  transform  of  the  effective 
service  time  of  a  class  2  customer  that  ends  leaving  the  ATC\  =  i  given  that  it  started 
with  the  ATCi  =  k.  Then 
E[e-°?\X2  =  x}  =  e—{ot(«)  +  j:J5sl[E1(*)]1jlofc(«)*a}k(«) 

Mi     Mi 

+  E  EPi(«)]iji[Si(»)]iA«ii(«)*«i.(«)*«Ji («)  +  —}. 

where  the  first  of  the  right-hand  side  terms  represents  the  probability  that  there  are  no 
interruptions  during  the  regular  service  time  of  the  low  priority  customer,  the  second  the 
probability  of  having  just  one  interruption,  where  we  have  to  take  into  account  the  ATC 
stage  of  the  high  priority  customer  at  the  end  of  the  type  1  busy  period,  and  so  on.  By 
writing  the  previous  formula  in  matrix  notation  we  obtain: 
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E\e-G>'\X2  =  x]  =e-"Bcl 


a\(x)     ■■■    <•(*) 


ai(aj)    ^ 


*  +  «— *LES.i 


(a1(*)[E1(*)]lll  +  ...+aMl(*)[Ei(*)]ij*J^ 

Using  (23)  we  obtain: 

£[e"'G*'|X2  =  x]  =  e-*?ke-(A*+A**W*ei. 

Therefore, 

E[e-^']  =  S*fc  $x2(>lo  +  i41E1(«)  +  *J)ei, 

and  hence, 

G2(a)  =  *A:2(^o  +  ^iS1(3)  +  5/).     □ 

Remark:  For  the  Poisson  case  we  obtain 

<I>g2{s)  =  4>x2{xi  -  \i<r(s)  +  s), 
which  is  in  agreement  with  Jaiswal  [9]. 


Preemptive  repeat  disciplines 

Let     3(f)  =  {ai(t ),..., afc(«),..., aMl («))'  and     4(t)  = 


di'(«) 


OMi'(*) 

Proposition  3    TVie  effective  service  time  G2  for  the  preemptive  repeat  discipline  under 
the  assumptions  of  Proposition  1  is  given  as  follows 

•   In  the  case  of  the  preemptive  repeat  different  discipline 


G2(s)  =  j"  A(x)  e-"fx,{x)dx  \l-  [°°  fx,{*)  [' S{y)e-*dydx  e*,  Sx(3) 
jo  L       Jo  Jo 

•   In  the  case  of  the  preemptive  repeat  identical  discipline 


i  -1 


G2(s)  =  J~  A(x)  [/  -  £  a(y)e-»dy  %  S,(a) 


e   "fxAx)dx- 
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Proof 

The  underlying  experiment  is  the  following: 

Assume  that  a  class  2  customer  enters  the  service  facility  at  r0  and  his  service  time  is  given 
by  a  value  of  the  r.v.  X^.  At  the  moment  he  enters  service  there  are  no  type  1  customers 
in  the  system  and  ATC\  =  k.  There  are  two  possibilities  for  the  remaining  time  until  the 
next  arrival  of  the  high  priority  arrival  process  : 

•  either  it  is  greater  than  the  selected  value  of  X2  and  in  this  case  G\l  =  X2,  where  i 
is  the  stage  of  the  ATC\  when  the  low  priority  finishes  service; 

•  or  it  is  less  than  the  selected  value  of  X2  and  at  the  moment  that  the  next  type  1 
customer  arrives  the  service  of  the  type  2  customer  is  interrupted  and  it  starts  over 
with  a  new  value  of  the  r.v.  Xi  as  soon  as  the  busy  period  initialized  by  the  type 
1  customer  is  over  for  the  preemptive  repeat  different  discipline  or  with  the  same 
value  of  the  r.v.  X2  for  the  preemptive  repeat  identical  discipline. 

So  for  the  repeat  different  case,  conditioning  on  X2  we  obtain 

E[e-G?\X2  =*]  =  a\{x)e->x  +  f  ak(y)e-'ydy  %  ^(s^s)  et. 

Jo 

Thus, 

&?"(«)=    [°°  ai(x)e-*  fXi(x)dx  +   r  fXl(x)  f  ak(y)e-*dydx  ^  Vi(s)Gi(s)  *, 
5  Jo  Jo  Jo 

And  in  matrix  form  : 

G2(s)  =  f°°  A(x)  e-*fX7{x)dx  \l  -  f°°  fXi(x)  f  <i(y)e-vdydx  %  ^(s) 
Jo  l       Jo  Jo 

Finally  for  the  repeat  identical  case  : 


i-i 


G2(s)  =  J~  A(x)  [/  -  £  <l{y)e-*dy  %  ^(s) 


e-xfxA*)d*-n 


In  the  case  of  Poisson  arrivals  we  can  obtain  the  results  of  Jaiswal  [9],  namely 

4>G,(*)  =  x       ^(3  +  Al) and 

I  -  -^-(l  -  4>X2(s  +  X^a.is) 
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<t>G7{s 


/•oo  e-(»  +  Ai  )x 


for  the  preemptive  repeat  different  and  the  preemptive  repeat  identical  discipline,  respec- 
tively. 

6.3      Preemptive  priorities 

In  this  section  we  analyze  a  generic  preemptive  discipline  in  terms  of  the  distribution  of 

the  effective  service  time.  In  this  way  we  are  able  to  analyze  all  preemptive  disciplines  we 

considered  in  a  unified  way. 

Let  Li,  Qi,  S{,  Wi,  Ri,  i  =  1,  2  be  the  system  and  queue  length,  system  and  waiting  time 

and  ATC  stage  of  the  arrival  process,  respectively,  of  class  t  =  1,2.  Notice  that  the  low 

priority  customer  that  may  be  in  the  service  box  without  being  served  is  not  taken  into 

account  in  the  number  of  low  priority  customers  in  the  queue. 

Let  Lf ,  Qf  and  Rf  be  the  number  of  customers  of  class  i  in  the  system,  in  the  queue 

and  the  ATC  stage  of  class  i,  respectively,  immediately  after  a  departure  epoch  of  class  2. 

Let  L~ ,  Q^  and  R~  be  the  number  of  customers  of  class  t  in  the  system,  in  the  queue 

and  the  ATC  stage  of  class  i,  respectively,  just  before  a  transition  epoch  of  the  arrival 

process  of  class  2.  A  transition  includes  both  arrivals  in  the  system  and  shifts  to  the  next 

exponential  stage  of  the  ATC  according  to  the  definitions  of  Section  2.2. 

Let  i°,  Q°  and  R°  be  the  number  of  customers  of  class  i  in  the  system,  in  the  queue  and 

the  ATC  stage  of  class  i,  respectively,  just  before  an  arrival  of  a  class  1  customer. 

We  also  define  the  matrices 

n+  =  [p{[l+  =nnRt  =  mnR+  =  i}]2l™1 1~"7 , 

P{Li  =nnJ2r  =  mnflJ  =  Z}Jm=i     /=j     , 

nn  =  [P{L2  =  nnJR1  =  mnJR2  =  /}C=f  •  H* , 
and  the  matrix  generating  functions 

nj,(*)  =  E  *nn+,  n-L2(z)  =  f;  2»n-,  and  nL2(z)  =  f;  z»nn. 

n=0  n=0  n=0 
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Exchanging  Li  with  Qi  we  similarly  define  the  generating  functions  Tli  (z),  Hq  (z)  and 

UQl(z). 

High  priority  customers 

As  long  as  the  discipline  is  preemptive  the  high  priority  customers  see  a  usual  MGE\ft  /G/l 

queue.  Therefore  ,  Theorem  8  can  be  used  to  find  the  distributions  of  L\,  Qi,  Si,  Wi. 

Low  priority  customers 

We  will  apply  the  exact  method  of  analysis  of  Section  4.  We  will  first  establish  relations 

between  L\,  L^   and  Li  and  L\  and  Q\  that  will  be  used  in  the  analysis  of  preemptive 

systems. 

Proposition  4  Let  Il£  (z),  Il£  (z)  and  Tli7(z)  be  the  matrix  pgf  for  the  post- departures, 
the  pre-transitions  and  the  general  time  probabilities  of  a  class  2  customer  for  a  preemptive 
priority  system  satisfying  the  assumptions  of  Theorem  1.   Then 

Tll2(z)=    nL2(z),  (47) 

and 

a2(i  -  z)  n+2(z)  =  {a0  +  Axy  nL,(z)  +  nLl(z)  (b0  +  zBx).  (48) 

Sketch  of  Proof 

First  we  apply  the  uniformization  technique  to  the  two  phase  renewal  processes  and  we 
choose  the  uniformization  constant  v  =  i/j  +  vi  such  that  v^  >  max  ^k,ik  for  k  —  1, 2,  i  = 
1, . . . ,  Mfc.  The  epochs  of  transitions  in  both  processes  are  therefore  Poisson  and  thus  (47) 
follows  from  PASTA. 

In  order  to  establish  (48)  we  follow  closely  the  approach  of  Bertsimas  and  Nakazato  [1] 
to  establish  the  relation  between  post-departures  and  the  pre-transitions  probabilities  in 
stochastic  processes  with  random  upward  and  downward  jumps.  We  first  write  down  the 
flow  balance  equations  for  all  states,  where  each  state  has  four  indexes  corresponding  to 
the  two  phase  type  arrival  processes,  and  then  we  use  the  fact  that  our  priority  discipline  is 
preemptive,  i.e.,  class  2  departures  can  only  happen  if  there  are  no  class  1  customers  in  the 
system.  Finally,  by  taking  generating  functions  in  the  number  of  low  priority  customers  in 
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the  system  we  obtain  (48).  The  computations  are  algebraically  involved  but  conceptually 
simple.  □ 

Proposition  5   In  a  preemptive  single  server  priority  system  with  two  classes  of  customers 

each  arriving  according  to  a  generalized  Erlang  distribution  : 

Mi 
K  n£,(*)  e,-  =  £  e*fc  n+2(z)  *G»,(2?o  +  zBt)  ?;.  (49) 

k=i  J 

Proof 

Conditioning  on  the  state  of  the  queue  that  a  class  2  customer  left  behind  at  the  moment 
he  started  service  and  the  duration  of  the  effective  service  time  we  obtain 

p{L+  =  n,R+  =  i,R+  =  j}  = 

T,Y,Y,  p{Qt  =  k,Ri=™,Rt  =  i}       bl(t)*b^-k-1\t)*b{(t)dFGm4t). 

By  writing  the  previous  equation  in  matrix  form  we  obtain  (49).   □ 

Let  Ei,,   k  =  1,2  be  the  number  of  class  k  customers  in  queue  given  that  no  class  k 

customer  is  in  the  service  box.  Let  Afc  be  the  number  of  class  k  customers  in  queue  given 

that  there  is  a  class  Jfc  customer  in  the  service  box.   We  introduce  the  matrix  generating 

functions 

UEj(z)  =  f;  z"  [P{E2  =  nnRl  =  inR2  =  j}f=M>  j=f>  , 


n=0 

oo 


nA,(2)  =  £  z»  [P{A2  =  nnR1  =  inR2  =  ;}])=f •  jff' . 


it=Mj  j=Mj 
n=0 

Furthermore,  let  E  be  an  Mj  x  M2  matrix  and  H2  be  an  M2  vector  such  that  S;,j  = 
P  {Ri  =  i,  R2  =  j  |Ii  =  0,  L2  =  0}  and  H2r  =  P  {R$  =  r  \L\  =  0,  L\  =  0}  .  Finally,  let 
B\  i  be  the  forward  recurrence  time  of  a  class  1  busy  period  that  ended  while  ATC\  =  t. 
Then  the  Laplace  transform  of  B\  ,-,  o~\  {(s)  is  given  by  : 

l-[Vi(s)]u 

°^S)  ~      sE[Bhl]     ■ 

We  also  introduce  the  traffic  intensities  pi  =  A^fA",],  p  =  p\  +  p2  and  we  define 
Pa,  =  /'{one  class  t  customer  is  in  the  service  box}.  Our  main  result  is 
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Theorem  12  In  a  preemptive  queueing  system  with  two  priority  classes  each  of  which 
satisfies  the  assumptions  of  Theorem  1  and  has  mixed  generalized  Erlang  interarrival  times 
characterized  by  matrices  Ao,  A\  and  Bq,B\  respectively,  the  matrix  generating  function 
of  the  number  of  low  priority  customers  in  queue  is  calculated  as  a  function  of  the  system 
characteristics  and  the  effective  service  time  matrix  from  the  following  algorithm: 

1.  Calculate  the  matrix  generating  function  Il£;3(2)  such  that: 

nE,(,)ei  =  (l-/>i)H«i+Pi  J?a'*Blv(*o  +  *£i),  t  =  l M2,        (50) 

where 

■=     -  1-Pi,iKiE[X1]-p2,j\2,jE[X2)  \i  *ff  A2  *j* 

=-i,3  ~  i ~ " T-  11 "   ~  Pl,rJT 11(1  -  P2>r), 

1  ~  Pi  ~  Pi  M,i  rVl  A2.J  r  =  l 

2w=l  Lr  =  l  Al,(Pl,/=/,r 

and  2?J ,   t«  </ie  forward  recurrence  time  of  a  class  1  busy  period  that  ends  while 
ATC\  =  i,  and  has  Laplace  transform   o~\ ^(s)    —       ,e\b    ]'' 

2.  For  i  =  1, . . .,  M\  solve  the  system  that  would  give  the  postdeparture  probabilities 

£et  n+2(2)  *Gki(B0  +  zBx)     -  z  cj  n+2(z)  = 
fc=i 

^~(i-PA3)[(^o  +  >ii)'n£j(z)+  nE3(2)(B0  +  251),]         (5i) 

A2 
TTie  con5<an<  p^3  is  calculated  from  the  relation 

limf  II+2(2)1  =  1. 

3.  The  general  time  queue  length  distribution  for  class  2  customers  is  calculated  by 
solving  the  system 

(Ao  +  Ai)#  nQ2(2)  +   TlQ2(z)  (Bo  +  zB1)  =  A2(l  -  z)  U+t(z). 
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4-    The  waiting  time  distribution  for  class  2  customers  can  be  calculated  by  applying  the 
distributional  law 

VHQa{z)  =  A2(l  -  z)€x  '*w2(Bo  +  zB!){B0  +  zBi)"1 . 

Proof 

Following  the  exact  method  of  analysis  of  Section  4,  our  strategy  for  calculating  the 
queue  length  distribution  for  class  2  customers  is  to  find  two  relations  between  IIjr„(z) 
and  IIq3(z)  and  then  solve  the  underlying  linear  system.  In  (49)  we  have  found  the  first 
relation  between  II  £  (z)  and  Ili  (z).  In  order  to  find  the  second  relation  we  condition  on 
whether  there  is  a  class  2  customer  in  the  service  box  and  we  obtain  that 

n<?2(z)  =  pa2  nA2(z)  +  (i  -  pa2)  nBa(z), 
nLi{z)  =  zPA2  nA2(z)  +  (i  - PAi)  nE3(z). 

Hence, 

nL,(z)  =  zUq2(z)  +  (1  -  z)(l  -  PAi)  UE2(z).  (52) 

In  order  to  find  Ue2(z)  we  use  the  following  argument: 

Because  of  the  preemptive  discipline,  class  1  customers  are  not  influenced  by  the  fact  that 
there  is  no  low  priority  customer  in  the  service  box;  so  the  server  serves  a  class  1  customer 
with  probability  p\  and  does  not  serve  class  1  customers  with  probability  1  —  p\.  In  order 
for  a  random  observer  to  see  n  >  1  class  2  customers  given  that  there  is  no  class  2  customer 
in  the  service  box,  he  has  to  arrive  during  a  class  1  busy  period.  Therefore,  if  we  denote 
by  #2r  the  probability  that  the  high  priority  customer  who  initialized  the  last  class  1  busy 
period  found,  upon  his  arrival,  the  class  2  customer  in  stage  r,  we  have  for  n  >  1 

P{E2  =  n,  R1=i,R2  =  j}=    PlJ2H^  br(t)*btn-V(t)*li(t)dFB;.(t). 

r=l  J° 

Similarly, 

P{E2  =  0,  Rr  =  i,R2  =  j}  = 

=  (1  -  pi)P{R1  =  i,R2  =  j  |  Xi  =  0,L2  =  0}+  pi£#2r  /     H(t)dFB.  (t). 

.,         Jo 


r  =  l 
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where  Fb-  ,(t)  is  the  cdf  of  the  forward  recurrence  time  of  a  class  1  busy  period  that  ends 
with  the  class  1  customer  being  in  stage  i.  Taking  generating  functions  (50)  follows. 
We  now  proceed  to  calculate  the  constants  appearing  in  (50). 

•a     -  pip   -  v  p   -  4  i  t    -  n  t    -  m  -  P^Ll  =_0_E_=  0, #i  =  »', #2  =  j}      ,.„-. 
Zij  -  P{R,  -  t,R2  _  j  |  ix  _  0,X8  _  0}  _ _________ .     (53) 

By  applying  Little's  law  to  the  server  we  obtain 

P{LX  =  0,  L2  =  0|  J?!  =  i,  R2  =  j}  =  1  -  p^Aj^JVi]  -  P2j\i,jE[X2], 

and  therefore,  using  (30)  we  have 

P{L,  =  0,  L2  =  0,  flx  =  i,  R2  =  j}  = 

{1  -  PuXisEiXi]  -  P2tJ\2iJE{X2}}-^  jj(l  -  Wir)iL  IJ(1  _  ft(P). 

AL'   r=l  A2.J  r=l 

We  also  know  that  P{L\  =  0,L2  =  0}  =  1  -    pi  -    p2  and  by  substituting  to  (53)  we 

obtain  Eij. 

Finally 

**  -  P{R>  -  '  I  ^  -  o,x,  -  0> ______ . 

But,  because  of  the  uniformization 

P{i;  =0,_5=  0,J2f  =  l,R°  =  r}  =  Xu^iPiL,  _  0,_2  =  0,i?x  =  /,_2  =  r} 
and  thus 

#         _  Et='l  Al,tPl.i"t.r 

ZW  =  1  _-r  =  l  Al./Pl,/-/,r 

Multiplying  (52)  with  (A0  +  A\)'  from  the  left  and  with  (B0  +  zBi)  from  the  right  and 
using  (49)  we  obtain  (51).  Notice  that  (51)  determines  lit  (2)  up  to  the  constant  p&7 
which  is  calculated  from  the  relation 

UmPnj1(*)r-i. 
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Having  found  Ili  (z),  we  find  U.q2(z)  from  (48),  while  the  waiting  time  W2  can  be  calcu- 
lated by  applying  the  distributional  law  (11): 

VllQa(z)  =  A2(l  -  z)^'*Wa(B0  +  zBx){B0  +  zBi)-1.    D 

Remarks: 

1.  In  the  case  of  Poisson  arrival  processes  (51)  gives  : 

nM        ln      n     W1       ,  ,A2(l-z)  +  A1(l-(r1(A2-A2z)) 
n2(z)  -  —(1  -  PaJ(1  -  a>i) -r— 7T 7— t ; , 

which  is  exactly  the  relation  obtained  in  Keilson  and  Servi  [11]  using  a  different 
derivation.  The  probability  p^2  can  be  obtained  either  by  requiring  lim,_i  IIq  (z)  = 
1,  which  in  this  case  leads  to  p&7  =  A2£^[Gr2]  or  by  applying  Little's  law  in  the 
service  box. 

2.  The  system  time  for  class  2  customers  is  found  from 

52  =  W2  ©  G2, 

while  (52)  offers  a  a  way  to  calculate  the  distribution  of  the  number  of  class  2 
customers  in  the  system  once  the  distribution  of  the  number  of  class  2  customers  in 
the  queue  is  determined. 

6.4      Non-preemptive  priorities 

In  this  section  we  analyze  the  single  server  priority  system  under  a  non-preemptive  dis- 
cipline, where  an  arriving  high  priority  customer  that  finds  a  low  priority  customer  in 
service  does  not  interrupt  the  service  in  progress.  Therefore,  the  effective  service  time  for 
class  2  customers  under  a  non-preemptive  priority  discipline  is  G2  =  X2.  Furthermore,  as 
no  customer  stays  in  the  service  box  unless  he  is  actually  being  served,  the  waiting  time 
is  in  this  case  defined  without  ambiguity,  exactly  as  in  the  case  of  a  single  MGEm/G/1 
queue.  We  will  first  calculate  the  distribution  of  the  number  of  class  1,  customers  in  the 
queue  and  in  the  system. 
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High  priority  customers 

Due  to  the  fact  that  we  do  not  allow  preemption,  the  number  of  class  1  customers  in 

the  queue  as  well  as  their  waiting  time  are  influenced  by  the  possible  existence  of  a  class 

2  customer  in  the  service  facility.    Let  R\'  be  the  stage  of  ATC\,  just  before  a  class  2 

customer  enters  service. 

Let  B{  be  the  event  that  the  server  is  busy  servicing  a  class  i  customer  at  a  random  time 

of  observation. 

Let  Aj  be  the  number  of  class  1  customers  in  queue  given  that  there  is  a  class  1  customer 

in  service.  We  introduce  the  vector  generating  function: 

PAl(z)  =  J  z"[P{Ai  =  n  n  R,  =  t}]|lf  >, 

z=0 

and  the  scalar  generating  function  G&1(z)  =  Ylt^o  znP{Ai  =  n}.  We  also  introduce  the 
row  vectors  E  and  S\,  such  that: 

Et  =  P{LX  =  0,  L2  =  0,  Ri  =  i}     and     Hlr  =  P{R\*  =  r}. 

Finally  we  will  use  H  as  denned  in  Section  4,  i.e 

A  i_1 

Hi  =  r-i-(l  -  Xi,iPi,iE[X1])  11(1  -  px.fc). 

Theorem  13  In  a  non-preemptive  queueing  system  with  two  priority  classes  each  of  which 
satisfies  the  assumptions  of  Theorem  1  and  has  mixed  generalized  Erlang  interarrival  times 
characterized  by  matrices  A0,  Ai  and  B0,  B\  respectively,  the  vector  generating  function  of 
the  number  of  class  1  customers  in  the  queue  and  in  the  system  is  given  as  a  function  of 
the  system  characteristics  as  follows  : 

PQl(z)  =  (1  -  z)[p2Hx$x;{A0  +  zA1)  +  E]  [*Xl(Ao  +  zAx)  -  zl)~\  (54) 

PLl(z)  =  {l-z)\p2Hi  iX;(A°+zAi)+  ^  [ixMo+zM)-  zl]~l  ^{Ao+zAt),  (55) 

where, 

X     ,_1 
E,  =  {1-  pi,i\UE[Xi]  -  \2E[X2]}-r±- 11(1  -  Pi.fc)>  (5g) 

Al>«  fc=i 
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and  H\  satisfies  : 

A  *~X 

p2P,  ix.(A0  +  A^Si  =  -^-(1  -  Xi^.iElXi])  I](l  -  Pi,k)  -  Ei 

Al-'  fc=i 

Proof 

From  the  vector  distributional  law  (28)  we  have: 

Pl1(z)  =  Pq1{z)9Xi(A0  +  zA1).  (57) 

We  should  establish  a  second  relation  between  Pia{z)  and  Pq1(z).  Consider  a  random 
observer  of  the  system  and  let  B{  be  the  event  that  the  server  is  busy  servicing  a  class  t 
customer  at  the  time  of  observation.  By  applying  Little's  law  to  the  server  P{Bi}  =  pi 
and  by  conditioning  on  the  events  B{  we  have,  for  n  >  1  : 

P{Qr  =  n,Ri  =  i}  =  PlP{Ql  =n,R1  =  t|£i}  +  p2P{Qi  =  n,Rl  =  i\B2}, 

or  by  using  the  definition  of  Ai  : 

P{Q1  =  n,R1  =  0  =  plP{A1  =n,Ry  =  i}  +  p2P{Qi  =n,Rr  =  i\B2}, 

and  for  n  =  0  we  also  have  : 

P{Q1  =  0,R1  =  i}  = 

PiP{A!  =0,Ri  =  i}  +  P2P{Qi  =0,Rx  =  i\B2)  +  P{ZX  =  0, L2  =  0, R1  =  i} 

or  equivalently  : 

P{Q,  =  0,  #j  =  *}  =  piP{Ai  =  0,  R^  =  i}  +  P2P{Qx  =  0,  #!  =  t|P2}  +  Ef. 

Furthermore,  if  we  denote  by  /flr  the  probability  that  ATC\  =  r  just  before  a  type  2 
customer  enters  service,  we  have  that  for  n  >  1: 

P{Q1  =  n,R1  =  i\B2)  =  £#ir  /      ar(*)*«(n~1)(0*«i(0  <***,•(<)• 
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and      P{Q1  =0,Ri  =  i\B2)  =  £*?,  Hlr  /0°°  4(t)  dFx.(t). 
By  taking  generating  vector  functions  we  get  : 

PqAz)  =  pAi(z)  +  P2&i  *x;{A0  +  zAx)  +  &. 
Using  the  same  analysis  for  the  number  of  customers  in  the  system  we  also  obtain: 

PlAz)  =  Pi*P±xi*)  +  *>2#i  *x;{A0  +  zAi)  +  &. 
Combining  the  last  two  equations  we  have: 

PlA2)  =  zPqi(z)  +  P2(l  -  z)S2  iX;{A0  +  zAx)  +  (1  -  z)M.  (58) 

From  (57)  and  (58)  we  obtain  (54)  and  (55).  Finally  we  need  to  calculate  the  vectors  Hx 
and  £.  First  note  that  £,  =  P{Li  =  0,  L2  =  0,  Ri  =  t'},  so  by  applying  Little's  law  to 
the  server  we  get  (56).  In  order  to  calculate  Sx  we  recall  that  in  a  regular  MGEm/G/1 
queue  (25)  holds,  namely 

PL{z)   =   {l-z)8{$Xl{A0  +  zAi)-zI)-1*Xl(A0  +  zAl). 

But  Pil  (1)  =  -Pl(I),  since  the  tth  component  of  this  vector  represents  the  probability  that 
the  ATC  of  the  arrival  process  of  class  1  is  in  stage  i.  Thus  by  taking  the  limits  as  z  — ►  1, 
we  get 

PiHx  iX;{Ao  +  Ax)  =  M-M, 

where  Hi    =    ^(1  -  XijPi,lB[Xi])lfc}1(l  -  Pi,k).   D 
Remarks  : 

•  Using  (54)  and  (55)  as  well  as  the  vector  distributional  law  one  can  easily  calculate 
the  waiting  time  distributions,  as  in  the  case  of  the  single  MGEm/G/1  queue. 

•  Note  that  once  again  for  Poisson  arrivals  (54)  take  the  form: 

GQl(z)  =  (1  -  z)[p2<l>X;(\i  -  \tz)  +  (1  -  Pl  -  P2)](*jr,(Ai  -  Xiz)  -  z)~\ 
which  is  the  exactly  the  result  obtained  in  Keilson  and  Servi  [11]. 
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Low  priority  customers 

The  waiting  time  of  the  low  priority  customer  equals  in  distribution  the  total  unfinished 
work  in  the  system  at  the  moment  of  his  arrival  subject  to  generalized  Erlang  interruptions, 
corresponding  to  class  1  arrivals.  As  the  work  in  the  system  as  well  as  the  distribution 
and  duration  of  the  interruptions  do  not  depend  on  whether  we  give  non-preemptive  or 
preemptive  resume  priority  to  the  class  1  customers  we  can  conclude  that  the  waiting  time 
distribution  for  the  low  priority  customer  under  a  non  preemptive  policy  is  the  same  as  the 
waiting  time  under  a  preemptive  resume  policy  (see  Keilson  and  Servi  [11]).  However  this 
is  not  true  for  the  waiting  time  in  the  system  because  of  the  notion  of  the  effective  service 
time  that  we  used  in  the  preemptive  priority  analysis.  Nevertheless  we  can  calculate 
all  the  distributions  of  interest  by  using  the  distributional  laws  as  well  as  the  relation 
52  =  W2@X2. 

7      Concluding  Remarks 

We  have  demonstrated  that  overtake  free  systems  can  be  analyzed  in  a  unified  way  through 
the  distributional  laws,  which  we  believe  deserve  a  more  prominent  place  in  queueing  the- 
ory. More  than  providing  a  method  of  analysis  for  a  class  of  systems,  the  paper  identified 
a  subdivision  of  queueing  theory  into  overtake  free  systems,  which  can  be  analyzed  us- 
ing distributional  laws,  but  are  unfortunately  a  small  subset  of  the  systems  encountered 
in  applications,  and  systems,  which  allow  overtaking,  which  are  not  analyzable  directly 
through  the  techniques  of  this  paper. 

In  the  case  of  overtake  free  systems,  we  showed  several  insights  and  new  results  that  can 
be  obtained.  One  which  we  consider  particularly  satisfying  is  the  derivation  of  heavy  traffic 
results  (usually  derived  using  diffusion  methods)  and  exact  results  can  be  achieved  in  a 
unified  way  using  the  asymptotic  and  exact  method  of  analysis  based  on  the  distributional 
laws. 

The  distributional  laws  only  provide  a  partial  answer  (only  for  overtake  free  systems) 
to  the  question  we  raised  in  the  first  section  of  the  paper  regarding  the  laws  of  queueing 
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theory.  The  major  open  problem  is  to  identify  queueing  laws  for  systems  that  allow 
overtaking,  which  lead  a  complete  solution.  This  is  a  rather  challenging  but  important 
problem  as  it  includes  well  known  open  problems  as  special  cases  (GI/G/s,  queueing 
networks,  etc.).  A  solution  to  this  problem  will  lead,  however,  to  a  more  complete  theory 
of  queues  and  is  likely  to  provide  very  valuable  new  insights. 
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